Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
e0be0ac
[python] [WIP] Initialize ray.merge_paimon connector
XiaoHongbo-Hope May 25, 2026
ef359af
[python] Fix ray merge_paimon NameError and schema alignment bugs
XiaoHongbo-Hope May 28, 2026
308311c
[python] Fix ray merge_paimon multi-source semantics and deprecated d…
XiaoHongbo-Hope May 28, 2026
2a7a4fb
[python] refactor ray merge_into module
XiaoHongbo-Hope May 28, 2026
714bb29
[python] wire ray merge_into not-matched INSERT path
XiaoHongbo-Hope May 28, 2026
99b88dd
[python] wire ray merge_into matched UPDATE path
XiaoHongbo-Hope May 28, 2026
ebe771b
[python] simplify ray merge_into clause surface
XiaoHongbo-Hope May 28, 2026
57b0a45
[python] redesign ray merge_into clause API
XiaoHongbo-Hope May 28, 2026
ccd9c9d
[python] revert unused shuffle helper extraction
XiaoHongbo-Hope May 28, 2026
81438c5
[python] refactor ray merge_into execution path
XiaoHongbo-Hope May 28, 2026
9384be0
[python] parallelize ray merge_into insert path
XiaoHongbo-Hope May 29, 2026
41024dc
[python] parallelize ray merge_into self-merge path
XiaoHongbo-Hope May 29, 2026
3143865
[python] distribute ray merge_into update path end-to-end
XiaoHongbo-Hope May 29, 2026
333eb31
[python] address ray merge_into review findings
XiaoHongbo-Hope May 29, 2026
a1b8a93
[python] tighten ray merge_into edge cases and src-row identity
XiaoHongbo-Hope May 29, 2026
c4af065
[python] optimize ray merge_into hot path with vectorized fallback
XiaoHongbo-Hope May 29, 2026
5fc8a7e
[python] align ray merge_into cardinality and self-merge with spark
XiaoHongbo-Hope May 29, 2026
0c04650
[python] distribute ray merge_into not-matched insert via anti-join
XiaoHongbo-Hope May 29, 2026
51d1bb5
[python] guard ray merge_into correctness and dependency edges
XiaoHongbo-Hope May 29, 2026
bacd07e
[python] narrow ray merge_into blob guard to update path
XiaoHongbo-Hope May 29, 2026
2b76ad2
[python] size ray merge_into update shuffle to actual group count
XiaoHongbo-Hope May 29, 2026
ad70c4d
[python] vectorize _assign_frid row-id bucketing
XiaoHongbo-Hope May 29, 2026
e9fb3a6
[python] fuse ray merge_into matched/not-matched into one outer join
XiaoHongbo-Hope May 29, 2026
74a56a5
[python] cover ray merge_into unified path with both clauses
XiaoHongbo-Hope May 29, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions paimon-python/dev/requirements-dev.txt
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,9 @@
duckdb==1.3.2
flake8==4.0.1
pytest~=7.0
# Ray: 2.48+ has no wheel for Python 3.8; use 2.10.0 on 3.8, 2.48.0 on 3.9+
ray>=2.10.0
# merge_into needs Dataset.join (added in Ray 2.50). Python 3.8 has no 2.50 wheel.
ray>=2.10.0; python_version < "3.9"
ray>=2.50.0; python_version >= "3.9"
requests
parameterized
# Vortex 0.71.0 regresses native predicate pushdown on single-row files.
Expand Down
13 changes: 12 additions & 1 deletion paimon-python/pypaimon/ray/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,16 @@
# under the License.

from pypaimon.ray.ray_paimon import read_paimon, write_paimon
from pypaimon.ray.data_evolution_merge_into import (
WhenMatched,
WhenNotMatched,
merge_into,
)

__all__ = ["read_paimon", "write_paimon"]
__all__ = [
"read_paimon",
"write_paimon",
"merge_into",
"WhenMatched",
"WhenNotMatched",
]
Loading
Loading