The dataset catalog
A data file is not turned into text. It goes into one DuckDB file for the folder, and a dataset catalog lists its tables and statistics. The assistant reads the catalog, not your rows, and Python can query the tables.
Follow along: download NearbyPark1500ft.csv (413 KB) and add it to a folder. It is a trimmed copy of public police incident records from the Dallas open data site.
1. Add a data file
Add Excel, CSV, and other data files like any document. They are not summarized.
Expand2. Read the catalog
Press View on the catalog to see each table's fields, how much is missing, and common values.
ExpandGood to know
- A chat that reads the folder can use these tables from Python, by name.
- With Remove PII on, CSV, TSV, JSON, and Excel files are redacted first, and the upload is not kept. It cannot look inside Parquet, SQLite, Feather, Stata, or SAS files, so those are refused.