Move pyarrow to requirements-full.txt?

[thomasstvr]

Pyarrow is a large package and is only used to read and write parquet files. I think we should move it to requirements-full.txt. What do you think @ebhills?

I noticed that wrangles took significantly longer to install recently than it had in the past, so I did some investigating. Below shows the size increase of the package (including dependencies) over the past few versions.

[mborodii-prog]

@thomasstvr Agreed — pyarrow is only used for Parquet read/write in the file connector, so it doesn't need to be a hard dependency for everyone.

I've put together a fix on fix/move-pyarrow-to-optional-requirements: #1146

Moved pyarrow from requirements.txt to requirements-full.txt.
In wrangles/connectors/file.py, switched the eager import pyarrow to the LazyLoader pattern we already use for every other optional connector dependency (duckdb, pyodbc, boto3, psycopg2, etc.), so it's only actually imported the moment a Parquet file is read or written — not at import wrangles time.
Tested both ways:

With pyarrow installed: Parquet read/write still round-trips correctly, full file connector test suite passes.
With pyarrow uninstalled: import wrangles still works, CSV/JSON/Excel read/write still work, and trying to read/write .parquet raises a clear error pointing at pip install pyarrow / requirements-full.txt instead of failing silently or breaking the whole import.

[thomasstvr]

Perfect, thanks

[ebhills]

works for me. We will install full on recipe-lambda, correct? Eric Hills +1 512 788-4036 ***@***.***

…

On Tue, Aug 25, 2026 at 3:56 PM Thomas K Stover ***@***.***> wrote: *thomasstvr* left a comment (wrangleworks/WranglesPY#1145) <#1145 (comment)> Perfect, thanks — Reply to this email directly, view it on GitHub <#1145?email_source=notifications&email_token=AMWG3CKR5F6WX6EDMEMBHQL5LX4ODA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTKNBRGY3DMMRYGY2KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-5416662864>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMWG3CL5KGDUN2VKDE74SV35LX4ODAVCNFSNUABFKJSXA33TNF2G64TZHM2DCNZZGE2DENRXHNEXG43VMU5TKMRUG4YTKOBWG432C5QC> . You are receiving this because you were mentioned.Message ID: ***@***.***>