Commit 24b9d2c
[SPARK-55965][PYTHON] Add warning when pandas >= 3.0.0 is used with PySpark
### What changes were proposed in this pull request?
Add a `FutureWarning` in `require_minimum_pandas_version()` when pandas >= 3.0.0 is detected.
### Why are the changes needed?
PySpark does not yet fully support pandas >= 3.0.0. This adds a warning to inform users.
### Does this PR introduce _any_ user-facing change?
Yes. Users with pandas >= 3.0.0 will see a `FutureWarning` when using PySpark pandas-related features.
### How was this patch tested?
Existing tests.
Closes #54760 from Yicong-Huang/SPARK-55965.
Authored-by: Yicong Huang <17627829+Yicong-Huang@users.noreply.github.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>1 parent fa87249 commit 24b9d2c
1 file changed
+10
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
59 | 69 | | |
60 | 70 | | |
61 | 71 | | |
| |||
0 commit comments