langchain-ai/datafusion
1
0
Fork 0
mirror of https://github.com/langchain-ai/datafusion.git synced 2026-07-01 21:24:06 -04:00
Code Issues 3 Packages Projects Releases Wiki Activity

Commit Graph

  • 0c82adec71 Fix struct casts to align fields by name (prevent positional mis-casts) (#19674) kosiew 2026-01-23 12:05:34 +08:00
  • c2f3d6541f Support API for "pre-image" for pruning predicate evaluation (#19722) Kosta Tarasov 2026-01-22 18:01:55 -05:00
  • 736fa7cce9 feat(datafusion-spark): implement spark compatible unhex function (#19909) lyne 2026-01-23 06:15:20 +08:00
  • 7cf63f1b03 Refactor ListArray hashing to consider only sliced values (#19500) Jeffrey Vo 2026-01-23 07:14:41 +09:00
  • cf76352d90 Improve error message when string functions receive Binary types (#19819) Miao 2026-01-23 06:05:47 +08:00
  • 7a09e27762 fix: union should retrun error instead of panic when input schema's len different (#19922) Huaijin 2026-01-23 05:59:09 +08:00
  • f0e38df39e chore(deps): bump chrono from 0.4.42 to 0.4.43 (#19897) dependabot[bot] 2026-01-22 17:31:18 +01:00
  • efccfb1e4e Fix trailing whitespace in CROSS JOIN logical plan formatting (#19936) Michael Kleen 2026-01-22 17:30:17 +01:00
  • 9f27e933ae Coerce expressions to udtf (#19915) Xiangpeng Hao 2026-01-22 11:01:55 -05:00
  • bfe7d18ab4 perf: Optimize scalar fast path for iszero (#19919) Kumar Ujjawal 2026-01-22 21:30:05 +05:30
  • 6b7ddd8030 chore(deps): bump actions/setup-python from 6.1.0 to 6.2.0 (#19935) dependabot[bot] 2026-01-23 02:06:38 +11:00
  • 3b44bbf60c feat: support pushdown alias on dynamic filter with ProjectionExec (#19404) discord9 2026-01-22 22:03:17 +08:00
  • b2c29ac8d7 Include license and notice files in more crates (#19913) Andrew Kane 2026-01-20 23:14:08 -05:00
  • db64be9845 chore(deps): bump thiserror from 2.0.17 to 2.0.18 (#19900) dependabot[bot] 2026-01-21 14:58:27 +11:00
  • 10a1d4ea1b Remove UDAF manual Debug impls and simplify signatures (#19727) Jeffrey Vo 2026-01-21 12:56:27 +09:00
  • e82dc21d1b Feat : added truncate table support (#19633) Rosai 2026-01-21 09:18:05 +05:30
  • 4d8d48c0c7 perf: Optimize scalar performance for cot (#19888) Kumar Ujjawal 2026-01-21 09:14:22 +05:30
  • 406e5aa1eb test(wasmtest): enable compression feature for wasm build (#19860) ChanTsune 2026-01-21 12:41:59 +09:00
  • 774a7b5360 chore(deps): bump the proto group across 1 directory with 5 updates (#19745) dependabot[bot] 2026-01-21 14:41:10 +11:00
  • 9626776b4e fix: null in array_agg with DISTINCT and IGNORE (#19736) David López 2026-01-21 04:40:18 +01:00
  • 6b1a1cb81e fix: preserve state in DistinctMedianAccumulator::evaluate() for window frame queries (#19887) Kumar Ujjawal 2026-01-21 09:09:12 +05:30
  • 913d1c0a7c perf: Optimize signum scalar performance with fast path (#19871) Kumar Ujjawal 2026-01-21 09:04:48 +05:30
  • 35ebe7955e feat(spark): implement add_months function (#19711) cht42 2026-01-21 07:33:03 +04:00
  • dededf7c78 Disable failing array_union edge-case with nested null array (#19904) Jeffrey Vo 2026-01-20 23:04:29 +09:00
  • 84e1ccc0d3 chore(deps): bump sphinx from 8.2.3 to 9.1.0 in /docs (#19647) dependabot[bot] 2026-01-20 08:33:21 -05:00
  • 5b122cc0dd Consolidate cte_quoted_reference.slt into cte.slt (#19862) Anjali Choudhary 2026-01-20 19:00:00 +05:30
  • 1a5c100c7d chore(deps): bump taiki-e/install-action from 2.66.5 to 2.66.7 (#19883) dependabot[bot] 2026-01-20 19:04:13 +09:00
  • 4dfcd7b313 chore(deps): bump insta from 1.46.0 to 1.46.1 (#19901) dependabot[bot] 2026-01-20 19:03:24 +09:00
  • c35b897ea3 chore(deps): bump postgres-types from 0.2.11 to 0.2.12 (#19902) dependabot[bot] 2026-01-20 09:20:22 +00:00
  • b8fcd0135b chore(deps): bump tokio-postgres from 0.7.15 to 0.7.16 (#19899) dependabot[bot] 2026-01-20 20:19:56 +11:00
  • 3f77ee4f06 chore(deps): bump wasm-bindgen-test from 0.3.56 to 0.3.58 (#19898) dependabot[bot] 2026-01-20 20:19:22 +11:00
  • d90d0746d6 perf: Optimize round scalar performance (#19831) Kumar Ujjawal 2026-01-19 13:39:25 +05:30
  • 05451da3cf feat(spark): implement Spark date_diff function (#19845) cht42 2026-01-19 09:33:25 +04:00
  • 4ed808a83c feat(spark): add trunc, date_trunc and time_trunc functions (#19829) cht42 2026-01-19 08:13:57 +04:00
  • 936f959ddf Add FilterExecBuilder to avoid recomputing properties multiple times (#19854) Adrian Garcia Badaracco 2026-01-18 12:09:43 -05:00
  • fc7d090fb3 Spark date part (#19823) cht42 2026-01-18 20:29:57 +04:00
  • 8b179d93e2 perf: optimize spark_hex dictionary path by avoiding dictionary expansion (#19832) lyne 2026-01-19 00:29:07 +08:00
  • 0aab6a3d2f feat: support SELECT DISTINCT id FROM t ORDER BY id LIMIT n query use GroupedTopKAggregateStream (#19653) Huaijin 2026-01-18 23:01:51 +08:00
  • 3ea21aa332 perf: Optimize trunc scalar performance (#19788) Kumar Ujjawal 2026-01-17 08:42:43 +05:30
  • 1ab7e4184e Fix grouping set subset satisfaction (#19853) Pierre Lacave 2026-01-16 17:04:59 +01:00
  • e353eb08fb Project sort expressions in StreamingTable (#19719) Tim Saucer 2026-01-16 11:01:42 -05:00
  • 3d90d4b601 datafusion/common: Add support for hashing ListView arrays (#19814) Frederic Branczyk 2026-01-16 14:07:22 +01:00
  • 0c959d6d91 Doc: Add more blog links to doc comments (#19837) Andrew Lamb 2026-01-16 08:05:13 -05:00
  • 8afccc9510 Allow dropping qualified columns (#19549) Nick 2026-01-16 07:28:59 -05:00
  • ac67ae4af5 Ensure null inputs to array setop functions return null output (#19683) Jeffrey Vo 2026-01-16 21:28:20 +09:00
  • ab81d3bd2b Fix(optimizer): Make EnsureCooperative optimizer idempotent under multiple runs (#19757) danielhumanmod 2026-01-16 04:27:20 -08:00
  • c91dcfdb6a Docs: add additional links to blog posts (#19833) Andrew Lamb 2026-01-16 07:26:02 -05:00
  • f3f6dec7c9 feat: Add support for 'isoyear' in date_part function (#19821) cht42 2026-01-16 16:22:58 +04:00
  • 5e893ab921 fix: predicate cache stats calculation (#19561) feniljain 2026-01-16 17:47:50 +05:30
  • 9208f12873 [Minor] Reuse indices buffer in RepartitionExec (#19775) Daniël Heres 2026-01-16 13:09:50 +01:00
  • ca904b3086 Row group limit pruning for row groups that entirely match predicates (#18868) xudong.w 2026-01-16 14:51:06 +08:00
  • 5edda9b309 fix: calculate total seconds from interval fields for extract(epoch) (#19807) Miao 2026-01-16 12:00:42 +08:00
  • 444ddf2e1c Add BatchAdapter to simplify using PhysicalExprAdapter / Projector to map RecordBatch between schemas (#19716) Adrian Garcia Badaracco 2026-01-15 22:41:44 -05:00
  • 7b0ed2d616 Refactor Spark date_add/date_sub/bitwise_not to remove unnecessary scalar arg check (#19473) Jeffrey Vo 2026-01-16 11:06:05 +09:00
  • 1441269429 chore: refactor scalarvalue/encoding using available upstream arrow-rs methods (#19797) Jeffrey Vo 2026-01-16 11:03:44 +09:00
  • 14d919ddaa chore(deps): bump taiki-e/install-action from 2.66.3 to 2.66.5 (#19824) dependabot[bot] 2026-01-16 13:01:54 +11:00
  • 5d68b751c0 fix: trunc function with precision uses round instead of trunc semantics (#19794) Kumar Ujjawal 2026-01-16 07:27:42 +05:30
  • 7c9a76acf1 Use correct setting for click bench queries in sql_planner benchmark (#19835) Andrew Lamb 2026-01-15 18:05:17 -05:00
  • 54b848c077 feat(spark): implement substring function (#19805) cht42 2026-01-16 02:52:40 +04:00
  • de40f0c9f5 Docs: Fix some links in docs (#19834) Andrew Lamb 2026-01-15 17:50:28 -05:00
  • 6f92ea6005 chore(deps): bump actions/setup-node from 6.1.0 to 6.2.0 (#19825) dependabot[bot] 2026-01-15 14:10:31 -05:00
  • 094e7ee90a physical plan: add reset_plan_states , plan re-use benchmark (#19806) Albert Skalt 2026-01-15 21:10:30 +03:00
  • c173de1fc4 fix: expose ListFilesEntry (#19804) XL Liang 2026-01-16 02:07:24 +08:00
  • a414ea078d Issue 19781 : Internal error: Assertion failed: !self.finished: LimitedBatchCoalescer (#19785) Bert Vermeiren 2026-01-15 18:39:27 +01:00
  • eadbed51b5 perf: Optimize initcap scalar performance (#19776) Kumar Ujjawal 2026-01-15 10:17:21 +05:30
  • 0808f3a8d2 Improvements to list_files_cache table function (#19703) Andrew Lamb 2026-01-14 16:55:10 -05:00
  • 154ab70040 feat(spark): implement array slice function (#19811) cht42 2026-01-14 23:42:37 +04:00
  • f73da4da38 Add Reproducer for Issues with LEFT joins on Fixed Size Binary Columns (#19800) Tobias Schwarzinger 2026-01-14 18:06:23 +01:00
  • c4f039f53b chore(deps): bump taiki-e/install-action from 2.66.2 to 2.66.3 (#19802) dependabot[bot] 2026-01-14 09:05:42 -08:00
  • 79869a7537 feat: support Set Comparison Subquery (#19109) Ruihang Xia 2026-01-14 19:50:45 +08:00
  • 472a729afc Revert Workround for Empty FixedSizeBinary Values Buffer After arrow-rs Upgrade (#19801) Tobias Schwarzinger 2026-01-14 10:57:22 +01:00
  • 429f5a792f refactor: Optimize required_columns from BTreeSet to Vec in struct PushdownChecker (#19678) Kumar Ujjawal 2026-01-14 10:16:42 +05:30
  • 567ba75840 doc: Add an auto-generated dependency graph for internal crates (#19280) Yongting You 2026-01-14 10:33:41 +08:00
  • 6bf5e98b59 dev: Add a script to auto fix all lint violations (#19560) Yongting You 2026-01-14 10:32:08 +08:00
  • 1d19c52852 perf: improve performance of spark hex function (#19738) lyne 2026-01-14 09:31:03 +08:00
  • 2f10d453f3 Expose Spilling Progress Interface in DataFusion (#19708) xudong.w 2026-01-14 09:21:55 +08:00
  • 617700d1b3 Upgrade DataFusion to arrow-rs/parquet 57.2.0 (#19355) Andrew Lamb 2026-01-13 11:14:33 -05:00
  • 6267feef81 chore(deps): bump flate2 from 1.1.5 to 1.1.8 (#19780) dependabot[bot] 2026-01-13 08:05:56 -08:00
  • 4c67d02089 feat: Add null-aware anti join support (#19635) Liang-Chi Hsieh 2026-01-13 20:34:58 +08:00
  • 4e1bc79e00 fix: enhance CTE resolution with identifier normalization (#19519) Siyuan Huang 2026-01-13 19:48:46 +08:00
  • e076e59b2b Simplify expr = L1 AND expr != L2 to expr = L1 when L1 != L2 (#19731) Simon Vandel Sillesen 2026-01-13 12:45:23 +01:00
  • f60b68a28c Include .proto files in datafusion-proto distribution (#19490) Oleg V. Kozlyuk 2026-01-13 12:42:49 +01:00
  • ec974ee5f1 chore(deps): bump taiki-e/install-action from 2.66.1 to 2.66.2 (#19778) dependabot[bot] 2026-01-13 20:24:12 +11:00
  • 36880d89f7 Fix run_tpcds data dir (#19771) Gabriel 2026-01-13 09:20:45 +01:00
  • 803cce881b feat: implement Spark size function for arrays and maps (#19592) Yu-Chuan Hung 2026-01-13 12:15:20 +08:00
  • e8efd59203 chore(deps): Update sqlparser to 0.60 (#19672) Alan Tang 2026-01-13 10:54:12 +08:00
  • d484c09baf perf: Optimize floor and ceil scalar performance (#19752) Kumar Ujjawal 2026-01-13 02:24:22 +05:30
  • cb9ec127e6 slt: Add test for REE arrays in group by (#19763) Frederic Branczyk 2026-01-12 18:57:56 +01:00
  • 7716cae504 chore: update copyright notice year (#19758) Jeffrey Vo 2026-01-13 01:49:38 +09:00
  • 278950a764 Fix dynamic filter is_used function (#19734) Lía Adriana 2026-01-12 16:54:18 +01:00
  • 2fb9fb3fb9 Update the upgrading.md (#19769) xudong.w 2026-01-12 23:48:58 +08:00
  • 383e673ac3 Update 52.0.0 release version number and changelog (#19767) xudong.w 2026-01-12 23:48:46 +08:00
  • bd2f348059 Improve comment for predicate_cache_inner_records (#19762) xudong.w 2026-01-12 23:30:00 +08:00
  • d103d8886f chore: remove LZO Parquet compression (#19726) Kumar Ujjawal 2026-01-12 08:01:20 +05:30
  • f9697c14e2 chore(deps): bump indexmap from 2.12.1 to 2.13.0 (#19747) dependabot[bot] 2026-01-11 23:20:19 +11:00
  • 1c37638113 chore(deps): bump async-compression from 0.4.36 to 0.4.37 (#19742) dependabot[bot] 2026-01-11 23:09:10 +11:00
  • 1ddc639fae chore(deps): bump libc from 0.2.179 to 0.2.180 (#19748) dependabot[bot] 2026-01-11 22:57:16 +11:00
  • 4ca82cfdbf chore(deps): bump blake3 from 1.8.2 to 1.8.3 (#19746) dependabot[bot] 2026-01-11 22:46:39 +11:00
  • c03606547d chore(deps): bump sqllogictest from 0.28.4 to 0.29.0 (#19744) dependabot[bot] 2026-01-11 22:42:30 +11:00
  • 2067324f17 chore(deps): bump taiki-e/install-action from 2.65.15 to 2.66.1 (#19741) dependabot[bot] 2026-01-11 22:39:10 +11:00