Parquet - DataPageV2 support

[norberttech]

Change Log

Added

• Parquet - DataPageV2 support

Fixed

Changed

Removed

Deprecated

Security

---

Closes: #688

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.132mb -0.00%  | 353.280ms -2.19% | ±0.44% -69.13%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.789mb +0.01%   | 269.534ms +0.26% | ±0.30% +153.92% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.937mb +0.01%   | 572.047ms -0.36% | ±1.29% +962.90% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 233.497mb +0.01% | 786.134ms +1.48% | ±0.47% -51.49%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.783mb +0.01%   | 19.970ms +2.86%  | ±1.17% +75.43%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.783mb +0.01%   | 412.150ms +2.30% | ±1.37% +212.03% |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+-----------------+-----------------+------------------+
| benchmark                   | subject                  | revs | its | mem_peak        | mode            | rstdev           |
+-----------------------------+--------------------------+------+-----+-----------------+-----------------+------------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 87.050mb +0.00% | 49.920ms +3.83% | ±3.24% +8894.40% |
+-----------------------------+--------------------------+------+-----+-----------------+-----------------+------------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev         |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 93.290mb +0.00%  | 583.149ms +3.40% | ±1.10% +56.20% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 46.066mb +0.00%  | 70.285ms +1.32%  | ±0.93% +81.09% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 88.568mb +0.00%  | 61.027ms +1.03%  | ±0.03% -95.91% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 284.009mb +0.01% | 1.188s +1.57%    | ±0.88% -50.71% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 16.560mb +0.00%  | 40.688ms -1.81%  | ±0.51% -1.05%  |
+--------------------+----------------+------+-----+------------------+------------------+----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+-----------------+------------------+------------------+
| benchmark               | subject                    | revs | its | mem_peak        | mode             | rstdev           |
+-------------------------+----------------------------+------+-----+-----------------+------------------+------------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 60.659mb +0.00% | 2.246ms -10.01%  | ±0.55% -72.25%   |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 80.451mb +0.00% | 153.139ms +2.78% | ±0.19% -73.08%   |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 58.977mb +0.00% | 15.182ms +1.41%  | ±0.71% +162.81%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 59.798mb +0.00% | 1.804ms -4.82%   | ±1.97% +7.23%    |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 59.798mb +0.00% | 1.872ms -4.30%   | ±1.66% +83.14%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 59.011mb +0.00% | 2.802ms -2.15%   | ±2.84% +116.33%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 59.540mb +0.00% | 14.373ms +0.40%  | ±0.63% +0.60%    |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 59.539mb +0.00% | 14.350ms +0.34%  | ±1.59% +20.58%   |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 57.611mb +0.00% | 1.894μs +4.87%   | ±2.53% -1.79%    |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 57.611mb +0.00% | 0.400μs 0.00%    | ±0.00% 0.00%     |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 65.844mb +0.00% | 10.300ms -0.74%  | ±2.85% -3.83%    |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 91.364mb +0.00% | 49.742ms +0.95%  | ±0.91% -51.11%   |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 60.061mb +0.00% | 1.965ms +2.71%   | ±0.40% -57.37%   |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 62.330mb +0.00% | 34.305ms +3.87%  | ±1.68% +88.77%   |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 62.161mb +0.00% | 4.966ms +5.13%   | ±1.38% +425.26%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 57.611mb +0.00% | 37.327ms +0.26%  | ±2.74% +354.83%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 57.611mb +0.00% | 37.724ms +1.40%  | ±1.11% +24.83%   |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 57.611mb +0.00% | 38.117ms +1.49%  | ±0.45% -42.76%   |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 59.885mb +0.00% | 7.328ms +0.48%   | ±0.80% +69.01%   |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 57.610mb +0.00% | 28.592ms +0.54%  | ±0.57% +124.61%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 57.611mb +0.00% | 13.062μs +1.95%  | ±2.91% +296.93%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 57.611mb +0.00% | 15.593μs +1.25%  | ±1.96% +0.00%    |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 80.452mb +0.00% | 160.173ms +2.01% | ±0.71% +0.58%    |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 91.719mb -0.01% | 122.041ms +4.83% | ±3.18% +43.43%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 47.595mb +0.02% | 58.936ms +2.63%  | ±0.73% +1180.61% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 12.392mb +0.01% | 13.784ms +2.01%  | ±0.69% -31.62%   |
+-------------------------+----------------------------+------+-----+-----------------+------------------+------------------+