Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • OnEach scalar function

Fixed

Changed

Removed

Deprecated

Security


Description

Closes: #1138

@github-actions
Copy link
Contributor

github-actions bot commented Aug 4, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.129mb +0.02%  | 511.045ms +0.62% | ±3.21% +541.23% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.262mb +0.02%  | 1.070s +1.11%    | ±0.56% -55.72%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 28.723mb +0.01% | 431.459ms +0.03% | ±0.64% +74.24%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 3.889mb +0.02%  | 34.194ms +1.74%  | ±1.05% -48.26%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 3.844mb +0.02%  | 309.526ms -0.48% | ±0.37% -86.98%  |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 116.231mb +0.00% | 59.469ms -0.12% | ±1.19% +97.56% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+-----------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode            | rstdev         |
+--------------------+----------------+------+-----+------------------+-----------------+----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.352mb +0.00%  | 84.872ms -5.02% | ±0.83% -76.06% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 102.673mb +0.00% | 52.685ms -0.81% | ±0.23% +72.24% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 124.002mb +0.00% | 1.230s -0.97%   | ±0.39% +10.45% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.146mb +0.00%  | 44.474ms +0.13% | ±0.43% +98.43% |
+--------------------+----------------+------+-----+------------------+-----------------+----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 52.811mb +0.00%  | 416.746ms +5.85% | ±3.24% +141.78% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 13.077mb +0.01%  | 78.996ms +0.72%  | ±1.20% +364.89% |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 86.987mb +0.00%  | 3.300ms -0.50%   | ±1.31% -43.53%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 102.589mb +0.00% | 190.374ms +0.63% | ±0.55% -23.59%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 85.309mb +0.00%  | 18.860ms +0.74%  | ±0.45% +74.02%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 88.227mb +0.00%  | 1.721ms -5.45%   | ±1.22% -31.60%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 88.227mb +0.00%  | 1.739ms -0.84%   | ±3.56% +36.57%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 85.339mb +0.00%  | 2.673ms +0.39%   | ±2.32% -9.82%   |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 85.868mb +0.00%  | 16.531ms +1.40%  | ±0.73% -37.04%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 85.868mb +0.00%  | 16.595ms +2.40%  | ±1.04% -49.61%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 83.772mb +0.00%  | 1.800μs +5.51%   | ±0.00% -100.00% |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 83.772mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 93.122mb +0.00%  | 12.322ms -1.62%  | ±0.79% -72.98%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 122.493mb +0.00% | 59.749ms -1.94%  | ±1.13% +69.36%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 86.388mb +0.00%  | 1.346ms +0.51%   | ±1.12% -61.45%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 89.738mb +0.00%  | 60.548ms -1.04%  | ±0.84% -27.90%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 88.489mb +0.00%  | 3.937ms -5.40%   | ±0.14% -96.04%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 83.920mb +0.00%  | 39.566ms -0.51%  | ±0.75% -70.12%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 83.921mb +0.00%  | 40.157ms +3.21%  | ±1.19% -24.81%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 83.920mb +0.00%  | 39.646ms +0.68%  | ±1.15% -4.44%   |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 86.213mb +0.00%  | 7.295ms -1.96%   | ±1.92% +197.84% |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 83.772mb +0.00%  | 28.554ms -1.99%  | ±0.08% -81.83%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 83.772mb +0.00%  | 13.500μs -2.13%  | ±0.00% -100.00% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 83.772mb +0.00%  | 16.121μs -1.56%  | ±0.78% -33.03%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 102.591mb +0.00% | 192.804ms +0.07% | ±0.42% -53.05%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 107.004mb +0.00% | 468.679ms -0.59% | ±1.18% +72.24%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 55.362mb +0.00%  | 236.577ms +0.65% | ±0.38% -57.79%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.200mb +0.01%  | 51.660ms -0.96%  | ±0.92% -59.36%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 897a13b into flow-php:1.x Aug 4, 2024
@norberttech norberttech deleted the feature/on-each-scalar-function branch December 5, 2024 20:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add onEach scalar function

1 participant