DataFrame::run method can now return execution report with Schema and Statistics

[norberttech]

Change Log

Added

• DataFrame::run method can now return execution report with Schema and Statistics

Fixed

Changed

Removed

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev         |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.258mb +0.00%  | 826.827ms +2.14% | ±1.19% +49.29% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.975mb +0.02%   | 340.837ms +0.66% | ±0.33% -27.64% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 5.127mb +0.02%   | 1.049s +1.26%    | ±0.22% +13.38% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.826mb +0.00% | 1.233s -0.37%    | ±0.50% -39.09% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.896mb +0.02%   | 34.881ms -0.82%  | ±0.41% -69.52% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.898mb +0.02%   | 429.959ms -0.16% | ±0.75% +16.46% |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.598mb +0.00% | 65.112ms +0.11% | ±0.81% -61.20% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+------------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev           |
+--------------------+----------------+------+-----+------------------+------------------+------------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 95.638mb +0.00%  | 460.660ms -0.47% | ±0.46% +2.60%    |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.112mb +0.00%  | 71.966ms -0.31%  | ±2.21% +1242.52% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 106.543mb +0.00% | 51.298ms -1.76%  | ±0.44% -20.43%   |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 321.748mb +0.00% | 1.493s +1.83%    | ±0.41% -24.15%   |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.936mb +0.00%  | 40.611ms +2.08%  | ±1.85% +641.25%  |
+--------------------+----------------+------+-----+------------------+------------------+------------------+

Building Blocks

+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.673mb +0.00%  | 3.429ms +3.76%   | ±2.68% +19.85%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.400mb +0.00%  | 180.739ms -2.00% | ±0.62% -41.94%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.925mb +0.00%  | 18.133ms -1.37%  | ±0.49% +37.34%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.913mb +0.00%  | 1.691ms +3.15%   | ±1.97% +36.07%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.913mb +0.00%  | 1.642ms -0.28%   | ±0.32% -47.19%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 75.025mb +0.00%  | 2.468ms +0.57%   | ±0.23% -71.75%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.554mb +0.00%  | 14.817ms -13.26% | ±1.37% -53.69%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.554mb +0.00%  | 14.991ms -11.95% | ±0.80% -55.47%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.458mb +0.00%  | 1.606μs -5.19%   | ±2.89% +2.04%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.458mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 87.012mb +0.00%  | 12.657ms -2.57%  | ±0.41% -79.27%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.373mb +0.00% | 62.013ms -4.90%  | ±1.61% +152.80% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 76.074mb +0.00%  | 1.300ms +8.76%   | ±2.74% +702.10% |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.420mb +0.00%  | 57.262ms -1.60%  | ±0.63% -36.03%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 78.175mb +0.00%  | 3.822ms +1.50%   | ±0.56% +375.84% |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.536mb +0.00%  | 38.939ms -3.76%  | ±0.88% -8.36%   |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.537mb +0.00%  | 40.777ms +0.78%  | ±2.02% +349.54% |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.536mb +0.00%  | 40.280ms -2.53%  | ±1.63% +11.74%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.899mb +0.00%  | 7.342ms -0.53%   | ±0.41% -36.19%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.458mb +0.00%  | 29.236ms -0.12%  | ±1.02% +73.93%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.458mb +0.00%  | 13.294μs +0.11%  | ±0.36% -62.01%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.458mb +0.00%  | 15.593μs -0.12%  | ±1.96% +225.79% |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.401mb +0.00%  | 188.416ms -1.86% | ±0.60% +653.35% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.704mb +0.00% | 495.217ms +0.76% | ±0.70% -6.51%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 60.183mb +0.00%  | 247.549ms +1.70% | ±1.04% +8.50%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 15.116mb +0.01%  | 52.453ms +0.31%  | ±1.30% -34.19%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.955mb +0.00%  | 431.171ms +1.31% | ±0.65% +235.76% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.494mb +0.01%  | 85.134ms -0.65%  | ±0.55% -47.80%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+