Commit Graph

30 Commits

Author SHA1 Message Date
Jiayu Liu 22fcb3d7a6 add requirements.txt of different python versions (#977)
* use 37 and 38
* update readme
* update ci as well
* adding version update guidance
2021-09-14 22:17:35 -07:00
QP Hou 5e2ce23b55 manage python binding metadata with pyproject.toml (#994)
* manage python binding metadata with pyproject.toml

* Generate full LICENSE.txt file in release CICD run
2021-09-14 22:05:01 -07:00
Ruihang Xia d6032f4e1f fix deadlink to DataFusion (#1002) 2021-09-14 16:37:53 -04:00
QP Hou 2615628007 register datafusion.functions as a python package (#995) 2021-09-13 18:02:31 -07:00
mmuru bfb3e6a8b2 Add support to perform sql query on in-memory datasource. (#981)
Co-authored-by: Muru Muthusamy <mmuthusamy@womply.com>
2021-09-12 22:25:55 -07:00
Jiayu Liu 141aed5a5a use nightly-2021-09-07 for python builds (#978)
* use nightly-2021-09-06

* use nightly-2021-09-07
2021-09-09 14:14:21 -04:00
QP Hou 75fc80c13f add cargo.lock file for python binding (#982) 2021-09-09 19:05:51 +02:00
QP Hou bb616bf94b update datafusion to 5.1.0 for python binding (#967)
* update datafusion to 5.1.0 for python binding
2021-09-07 21:32:03 -07:00
Francis Du 775477f037 [Python] - Support show function for DataFrame api of python library (#942)
* feat: Add show function for python library

* Update python/src/dataframe.rs

Co-authored-by: Andy Grove <andygrove73@gmail.com>
2021-08-29 18:27:55 -07:00
QP Hou 1fa6a7e5d6 build python wheels for release rc tags (#927) 2021-08-23 12:24:36 -07:00
QP Hou 96658eb100 Create changelog for datafusion and ballista release (#801)
* create changelog for datafusion and ballista release

Created changelog for the following projects:

* datafusion 5.0.0
* python 0.3.0
* ballista 0.5.0

Other changes:

* updated CHANGELOG.md in the repo root to point to changelogs in
subproject folders
* updated dev/release/update_change_log.sh to take subproject as argument
* added dev/update_ballista_versions.py to help update ballista crate versions.

* ignore autogenerated CHANGELOG.md from prettier run

* expand file glob within prettier

'**' pattern is not supported to some of the shells including the one we
use in CI.

* exclude subproject changelog from rat

* update changelog to latest master

* update changelog with updated pr labels

* update datafusion version in readme

* add verify-release-candidate.sh

* update changelog for latest master

* update release email formatting

* update verify-release-candidate.sh permission

* cargo test all in release verify script
2021-08-10 09:02:57 -07:00
Krisztián Szűcs 5a7bbccf95 Expose ExecutionContext.register_csv to the python bindings (#524)
* Expose register_csv

* Validate delimiter

* Fix tests

* Pass schema

* unused imports

* add linting

* Update deps

* Restore venv
2021-08-06 14:53:14 -04:00
Jiayu Liu 2a4f94e622 update python crate (#768) 2021-07-23 16:50:12 -04:00
Jiayu Liu 3a24113569 fix maturin version in pyproject.toml (#756) 2021-07-20 08:29:59 -04:00
Jiayu Liu 6cfaa29491 add more math functions and unit tests to python crate (#748)
* rename functions

* add test math functions

* add python math functions
2021-07-20 08:29:36 -04:00
Jiayu Liu c51e9ece18 update python crate to support latest pyo3 syntax and gil sematics (#741)
* update dependencies

* rename macros

* update pyo3 deprecate
2021-07-19 15:37:43 -04:00
Jiayu Liu a4f6cdd649 fix arrow type id mapping (#742) 2021-07-19 11:47:23 -04:00
Jiayu Liu afe29bd3c6 update python crate dependencies (#740)
* update dependencies

* rename macros
2021-07-18 07:28:34 -04:00
Jiayu Liu 4a65ee37ab fix python crate with the changes to logical plan builder (#650) 2021-07-02 17:18:47 -04:00
Jiayu Liu 3ef7f3495b use nightly nightly-2021-05-10 (#536) 2021-06-10 18:16:21 -04:00
Krisztián Szűcs 42f908e2b5 Define the unittests using pytest (#493)
* Use pytest

* Formatting

* Update GHA conf

* Remove TODO note

* Format

* Test requirements file

* Update workflow file

* Merge requirements file

* Update workflow file
2021-06-09 14:23:23 -04:00
Jiayu Liu e1a03a417e use requirements.txt to formalize python deps (#484)
* use requirements.txt to formalize python deps

* fix header

* update readme
2021-06-04 13:01:39 -04:00
Daniël Heres a0370b273c Implement missing join types for Python dataframe (#503)
* Implement missing join types for Python dataframe

* Fix mapping

* Use commit hash instead

* undo some changes

* Remove imports

* Undo removed part

* Undo removed part

* minimize changes
2021-06-04 18:37:15 +02:00
Jiayu Liu 53792ecf0b simplify python function definitions (#477) 2021-06-04 05:37:03 +02:00
Jiayu Liu e713bc3b33 update cargo.toml in python crate and fix unit test due to hash joins (#483)
* update cargo.toml

* fix group by

* remove unused imports
2021-06-03 17:45:52 -04:00
Krisztián Szűcs d0d677bb57 Expose DataFrame::sort (#469) 2021-06-02 16:41:45 -04:00
Javier Goday 9eca3291ce #374: Add missing functions to python (#388) 2021-05-23 10:43:25 +02:00
Andy Grove 3be087a788 Revert "Revert "Add datafusion-python (#69)" (#257)" (#270)
This reverts commit d0af907652.
2021-05-05 07:39:28 -06:00
Andy Grove d0af907652 Revert "Add datafusion-python (#69)" (#257)
This reverts commit 46bde0bd14.
2021-05-04 16:51:44 +02:00
Jorge Leitao 46bde0bd14 Add datafusion-python (#69)
* Added Python project.

* Update python/Cargo.toml

Co-authored-by: Andy Grove <andygrove@users.noreply.github.com>

* Update python/Cargo.toml

Co-authored-by: Uwe L. Korn <xhochy@users.noreply.github.com>

* Added license and black formatting.

* License

* Fixing build.

* TesTestt

* Bumped to latest DataFusion.

* Bumped nightly.

* Bumped pyarrow in tests.

* Added some tests back.

Co-authored-by: Andy Grove <andygrove@users.noreply.github.com>
Co-authored-by: Uwe L. Korn <xhochy@users.noreply.github.com>
2021-05-04 06:24:57 -06:00