* Update rust vesion to 1.57
* Clean ups related to clippy
* remove more unused fields
* Remove some more unused code
* remove data_type from Average, but keep in consutrctor
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Reuse wait_for_future from dataframe.rs
* Improve module organization
* Reorganize tests
* Support Binary and LargeBinary arrays for ScalarValue::try_from_array
* Define column and literal functions in python
* Apply isort
* Add test for importing from datafusion.functions
* Rename internals to _internal
* Make classes inheritable; add tests for imports; set module
* Remove PyVolatility
* Move ScalarUdf to udf.rs
* Factor out PyScalarUDF and PyAggregateUDF
* Refactor UDF and UDAF construction
* Set public as the default database for the catalog
* [feat] stubs for provider re-organization
* [feat] implement infer_schema to make test pass
* [wip] trying to implement pruned_partition_list
* [typo]
* [fix] replace enum with trait for extensibility
* [fix] add partition cols to infered schema
* [feat] forked file format executors
avro still missing
* [doc] comments about why we are flattening
* [test] migrated tests to file formats
* [test] improve listing test
* [feat] add avro to refactored format providers
* [fix] remove try from new when unnecessary
* [fix] remove try_ from ListingTable new
* [refacto] renamed format module to file_format
also removed statistics from the PartitionedFile abstraction
* [fix] removed Ballista stubs
* [fix] rename create_executor
* [feat] added store
* [fix] Clippy
* [test] improve file_format tests with limit
* [fix] limit file system read size
* [fix] avoid fetching unnecessary stats after limit
* [fix] improve readability
* [doc] improve comments
* [refacto] keep async reader stub
* [doc] cleanup comments
* [test] test file listing
* [fix] add last_modified back
* [refacto] simplify csv reader exec
* [refacto] change SizedFile back to FileMeta
* [doc] comment clarification
* [fix] avoid keeping object store as field
* [refacto] grouped params to avoid too_many_arguments
* [fix] get_by_uri also returns path
* [fix] ListingTable at store level instead of registry
* [fix] builder take self and not ref to self
* Replace file format providers (#2)
* [fix] replace file format providers in datafusion
* [lint] clippy
* [fix] replace file format providers in ballista
* [fix] await in python wrapper
* [doc] clearer doc about why sql() is async
* [doc] typos and clarity
* [fix] missing await after rebase
* Added function volatility to Signature
* Ran cargo fmt and clippy
* Added Stable function volatility
* Moved existing Signature functionality into TypeSignature and add Signature type which has volatility calssification
* Added function volatility to python bindings
* Made volatility method more explicit and signature less error-prone.
* ran formatters on code
* Made order of udf related functions in python more consistent
* create changelog for datafusion and ballista release
Created changelog for the following projects:
* datafusion 5.0.0
* python 0.3.0
* ballista 0.5.0
Other changes:
* updated CHANGELOG.md in the repo root to point to changelogs in
subproject folders
* updated dev/release/update_change_log.sh to take subproject as argument
* added dev/update_ballista_versions.py to help update ballista crate versions.
* ignore autogenerated CHANGELOG.md from prettier run
* expand file glob within prettier
'**' pattern is not supported to some of the shells including the one we
use in CI.
* exclude subproject changelog from rat
* update changelog to latest master
* update changelog with updated pr labels
* update datafusion version in readme
* add verify-release-candidate.sh
* update changelog for latest master
* update release email formatting
* update verify-release-candidate.sh permission
* cargo test all in release verify script
张林伟