Added offset option to parquet extractor

[norberttech]

Change Log

Added

• Added offset option to parquet extractor

Fixed

Changed

Removed

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.260mb +0.00%  | 820.461ms -0.25% | ±0.23% -68.97%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.978mb +0.01%   | 340.698ms -0.50% | ±0.22% -50.77%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 5.130mb +0.01%   | 1.046s -0.27%    | ±0.27% -18.85%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.833mb +0.00% | 1.246s +0.12%    | ±0.52% -26.41%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.898mb +0.01%   | 34.942ms -0.91%  | ±0.56% -34.13%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.900mb +0.01%   | 432.470ms +0.59% | ±0.79% +219.69% |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.600mb +0.00% | 65.485ms +2.72% | ±0.06% -83.99% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 95.641mb +0.00%  | 460.024ms -0.61% | ±0.32% -63.68%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.114mb +0.00%  | 72.935ms +1.66%  | ±0.68% +11.08%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 106.545mb +0.00% | 52.291ms +3.12%  | ±0.88% +26.99%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 321.755mb +0.00% | 1.487s +0.45%    | ±0.35% +231.80% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.939mb +0.00%  | 40.884ms +2.35%  | ±0.17% -84.02%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev           |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.675mb +0.00%  | 3.425ms +2.45%   | ±0.99% -24.23%   |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.402mb +0.00%  | 180.901ms +0.85% | ±1.00% +66.97%   |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.927mb +0.00%  | 18.207ms -0.29%  | ±0.40% +28.03%   |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.915mb +0.00%  | 1.816ms +16.32%  | ±2.48% +33.61%   |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.915mb +0.00%  | 1.770ms +10.52%  | ±1.34% -10.62%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 75.027mb +0.00%  | 2.583ms +6.77%   | ±2.13% +139.49%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.556mb +0.00%  | 14.680ms +2.77%  | ±0.81% +19.83%   |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.556mb +0.00%  | 14.650ms +0.72%  | ±0.87% -34.20%   |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.460mb +0.00%  | 1.706μs +0.36%   | ±2.72% +0.00%    |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.460mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%     |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 87.015mb +0.00%  | 12.940ms +0.62%  | ±0.89% +215.20%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.375mb +0.00% | 65.555ms +4.35%  | ±0.84% +105.51%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 76.076mb +0.00%  | 1.385ms +18.80%  | ±0.78% -49.21%   |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.422mb +0.00%  | 57.019ms +1.17%  | ±0.95% +26.81%   |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 78.177mb +0.00%  | 3.870ms +2.91%   | ±0.83% +60.23%   |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.538mb +0.00%  | 39.671ms -0.06%  | ±0.71% -54.28%   |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.539mb +0.00%  | 40.549ms +0.39%  | ±1.16% -19.16%   |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.538mb +0.00%  | 41.665ms +2.95%  | ±2.63% +1762.89% |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.901mb +0.00%  | 7.379ms +1.67%   | ±1.09% -33.93%   |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.460mb +0.00%  | 28.881ms +0.38%  | ±0.54% +23.88%   |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.460mb +0.00%  | 14.240μs +7.02%  | ±2.42% +583.52%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.460mb +0.00%  | 15.916μs +2.03%  | ±3.07% +485.75%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.403mb +0.00%  | 186.122ms +0.93% | ±0.74% +103.79%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.707mb +0.00% | 499.103ms +1.69% | ±1.41% +485.90%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 60.185mb +0.00%  | 254.311ms +4.56% | ±0.66% +38.50%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 15.118mb +0.00%  | 53.461ms +1.53%  | ±0.44% -33.24%   |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.958mb +0.00%  | 432.133ms +1.65% | ±0.76% +505.40%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.497mb +0.00%  | 85.894ms +0.86%  | ±0.18% -47.42%   |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+