Added memory consumption to dataset report

[norberttech]

Change Log

Added

• memory consumption to dataset report

Fixed

Changed

Removed

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+------------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject                | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+------------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k      | 1    | 3   | 4.775mb +0.01%  | 417.386ms +0.68% | ±0.57% +72.92%  |
| ExcelExtractorBench   | bench_extract_10k_ods  | 1    | 3   | 65.486mb +0.00% | 1.052s -1.01%    | ±3.10% -1.73%   |
| ExcelExtractorBench   | bench_extract_10k_xlsx | 1    | 3   | 67.532mb +0.00% | 1.676s -1.35%    | ±0.49% +35.16%  |
| JsonExtractorBench    | bench_extract_10k      | 1    | 3   | 5.018mb +0.01%  | 1.264s -1.42%    | ±0.71% -31.13%  |
| ParquetExtractorBench | bench_extract_10k      | 1    | 3   | 86.321mb +0.00% | 908.164ms -0.70% | ±0.26% -51.30%  |
| TextExtractorBench    | bench_extract_10k      | 1    | 3   | 4.499mb +0.01%  | 39.212ms +2.42%  | ±1.51% +755.00% |
| XmlExtractorBench     | bench_extract_10k      | 1    | 3   | 4.494mb +0.01%  | 602.825ms +1.41% | ±0.26% -69.41%  |
+-----------------------+------------------------+------+-----+-----------------+------------------+-----------------+

Transformers

+---------------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                       | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+---------------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench     | bench_transform_10k_rows | 1    | 3   | 123.236mb +0.00% | 65.280ms -1.84% | ±0.91% +53.17% |
| RenameEachEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 18.498mb +0.00%  | 71.591ms -0.42% | ±0.27% -79.41% |
+---------------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+-----------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode            | rstdev         |
+--------------------+----------------+------+-----+------------------+-----------------+----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 62.435mb +0.00%  | 86.925ms -0.79% | ±0.38% -61.18% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 79.706mb +0.00%  | 95.678ms -1.25% | ±0.37% -43.90% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 165.387mb +0.00% | 20.697s -0.69%  | ±0.07% -74.14% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.805mb +0.00%  | 30.981ms -2.26% | ±0.49% +67.25% |
+--------------------+----------------+------+-----+------------------+-----------------+----------------+

Building Blocks

+-------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+
| benchmark         | subject                    | revs | its | mem_peak         | mode             | rstdev                        |
+-------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 101.784mb +0.00% | 650.401ms -0.19% | ±0.84% +157.98%               |
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 53.134mb +0.00%  | 326.439ms +1.47% | ±0.61% -56.71%                |
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.384mb +0.00%  | 69.285ms -0.79%  | ±0.37% -19.52%                |
| RowsBench         | bench_chunk_10_on_10k      | 2    | 3   | 93.389mb +0.00%  | 3.224ms -0.90%   | ±1.68% +145.18%               |
| RowsBench         | bench_diff_left_1k_on_10k  | 2    | 3   | 110.758mb +0.00% | 234.648ms -2.15% | ±0.61% -0.22%                 |
| RowsBench         | bench_diff_right_1k_on_10k | 2    | 3   | 93.478mb +0.00%  | 23.659ms -1.34%  | ±0.41% -31.96%                |
| RowsBench         | bench_drop_1k_on_10k       | 2    | 3   | 94.264mb +0.00%  | 1.350ms -2.30%   | ±1.37% +136.54%               |
| RowsBench         | bench_drop_right_1k_on_10k | 2    | 3   | 94.264mb +0.00%  | 1.339ms -2.30%   | ±3.29% +15.42%                |
| RowsBench         | bench_entries_on_10k       | 2    | 3   | 92.424mb +0.00%  | 3.285ms -3.71%   | ±0.84% -65.83%                |
| RowsBench         | bench_filter_on_10k        | 2    | 3   | 92.953mb +0.00%  | 15.854ms -3.01%  | ±1.32% +505.22%               |
| RowsBench         | bench_find_on_10k          | 2    | 3   | 92.953mb +0.00%  | 15.571ms -2.26%  | ±1.09% +137.41%               |
| RowsBench         | bench_find_one_on_10k      | 10   | 3   | 91.642mb +0.00%  | 1.906μs +0.32%   | ±2.44% +20864134789308000.00% |
| RowsBench         | bench_first_on_10k         | 10   | 3   | 91.642mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%                  |
| RowsBench         | bench_flat_map_on_1k       | 2    | 3   | 100.703mb +0.00% | 14.185ms +0.71%  | ±0.30% +44.29%                |
| RowsBench         | bench_map_on_10k           | 2    | 3   | 130.130mb +0.00% | 67.082ms -0.65%  | ±1.12% +59.06%                |
| RowsBench         | bench_merge_1k_on_10k      | 2    | 3   | 93.473mb +0.00%  | 1.111ms -8.79%   | ±1.67% +18.15%                |
| RowsBench         | bench_partition_by_on_10k  | 2    | 3   | 96.841mb +0.00%  | 62.854ms -0.12%  | ±2.63% +750.99%               |
| RowsBench         | bench_remove_on_10k        | 2    | 3   | 94.526mb +0.00%  | 3.454ms -1.31%   | ±1.22% +2.51%                 |
| RowsBench         | bench_sort_asc_on_1k       | 2    | 3   | 92.003mb +0.00%  | 40.177ms +0.81%  | ±1.34% +199.52%               |
| RowsBench         | bench_sort_by_on_1k        | 2    | 3   | 92.004mb +0.00%  | 40.277ms +0.02%  | ±2.53% +44.66%                |
| RowsBench         | bench_sort_desc_on_1k      | 2    | 3   | 92.003mb +0.00%  | 40.193ms +1.23%  | ±1.11% +34.82%                |
| RowsBench         | bench_sort_entries_on_1k   | 2    | 3   | 94.085mb +0.00%  | 8.142ms -0.61%   | ±0.82% +689.89%               |
| RowsBench         | bench_sort_on_1k           | 2    | 3   | 91.835mb +0.00%  | 29.270ms -1.36%  | ±2.04% +70.87%                |
| RowsBench         | bench_take_1k_on_10k       | 10   | 3   | 91.642mb +0.00%  | 14.021μs +1.45%  | ±0.89% -1.43%                 |
| RowsBench         | bench_take_right_1k_on_10k | 10   | 3   | 91.642mb +0.00%  | 16.440μs +6.07%  | ±2.09% +296.71%               |
| RowsBench         | bench_unique_on_1k         | 2    | 3   | 110.759mb +0.00% | 237.733ms -2.37% | ±0.43% -47.90%                |
| TypeDetectorBench | bench_type_detector        | 1    | 3   | 42.070mb +0.00%  | 422.910ms +0.01% | ±0.34% -26.24%                |
| TypeDetectorBench | bench_type_detector        | 1    | 3   | 11.448mb +0.00%  | 85.590ms +0.28%  | ±0.67% +72.39%                |
+-------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.10%. Comparing base (180f06c) to head (5fbdb91).
Report is 2 commits behind head on 1.x.

✅ All tests successful. No failed tests found.

Additional details and impacted files

@@            Coverage Diff             @@
##              1.x    #1670      +/-   ##
==========================================
+ Coverage   82.08%   82.10%   +0.02%     
==========================================
  Files         703      703              
  Lines       19059    19062       +3     
==========================================
+ Hits        15644    15651       +7     
+ Misses       3415     3411       -4     

Components	Coverage Δ
etl	88.33% <100.00%> (+0.06%)	⬆️
cli	84.42% <ø> (ø)
lib-array-dot	94.53% <ø> (ø)
lib-azure-sdk	62.56% <ø> (ø)
lib-doctrine-dbal-bulk	90.11% <ø> (ø)
lib-filesystem	78.02% <ø> (ø)
lib-parquet	84.37% <ø> (ø)
lib-parquet-viewer	82.02% <ø> (ø)
lib-snappy	90.69% <ø> (ø)
bridge-filesystem-async-aws	90.38% <ø> (ø)
bridge-filesystem-azure	89.92% <ø> (ø)
bridge-monolog-http	96.38% <ø> (ø)
symfony-http-foundation	74.41% <ø> (ø)
adapter-chartjs	86.45% <ø> (ø)
adapter-csv	90.18% <ø> (ø)
adapter-doctrine	89.69% <ø> (ø)
adapter-elasticsearch	97.19% <ø> (ø)
adapter-google-sheet	83.87% <ø> (ø)
adapter-http	59.15% <ø> (ø)
adapter-json	90.62% <ø> (ø)
adapter-logger	53.84% <ø> (ø)
adapter-meilisearch	97.75% <ø> (ø)
adapter-parquet	78.42% <ø> (ø)
adapter-text	84.44% <ø> (ø)
adapter-xml	83.15% <ø> (ø)

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.