Log inSign up
polars data profile banner
user avatar

polars data

@DataPolars
Dataframes powered by a multithreaded, vectorized query engine, written in Rust.
Amsterdam
pola.rs
Joined July 2022
6
Following
7,402
Followers
RepliesMedia
  • user avatar
    polars data
    @DataPolars
    Aug 11
    Time series datasets are seldom perfect. Polars gives you a whole menu for repairing them, and the right pick depends on what you need. `fill_null` accepts more than a constant value to fill. `strategy="forward"` carries the last value forward, the natural choice for state that
    Image
  • user avatar
    polars data
    @DataPolars
    Aug 4
    We've released Polars Cloud client 0.10.0. Some of the highlights: • Stream query results into Python with `sink_batches()` • A new experimental query planner: Miso • Distributed `pl.collect_all()` • Hive-partition aware scans • On-Prem HDFS support Blog post:
    Image
  • user avatar
    polars data
    @DataPolars
    Jul 28
    Aggregating 500GB of compressed parquet with 16,000,000,000 rows to display it in an enterprise-ready Plotly dashboard. We explored a sample of the Polymarket dataset locally on a laptop, and once we got the pipeline like we needed it to be for the visualisations, we scaled it
    Image
  • user avatar
    polars data
    @DataPolars
    Jul 23
    We've released Python Polars 1.43. Some of the highlights: • pl.list() Pack a row's columns into a nested list, keeping each column's value as its own element so you get a list[col1.dtype, col2.dtype]. • ewm_sum() and ewm_sum_by() Exponentially weighted moving sums, where
    Image