Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • exclude DSL methods/functions through attributes

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

github-actions bot commented Dec 8, 2023

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.131mb +0.00%  | 689.887ms +0.07% | ±2.38% +612.10% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.830mb +0.01%   | 301.792ms -0.21% | ±0.52% +27.95%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.928mb +0.01%   | 929.757ms +0.75% | ±0.85% -32.80%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.634mb +0.00% | 1.107s +1.57%    | ±1.08% -7.85%   |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.707mb +0.01%   | 25.095ms +2.75%  | ±1.68% -29.07%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.708mb +0.01%   | 405.144ms -0.39% | ±0.35% -22.49%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev          |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.393mb +0.00% | 63.909ms +2.02% | ±1.22% +266.90% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.792mb +0.00%  | 435.110ms -3.62% | ±0.42% -75.83%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.870mb +0.00%  | 70.482ms -0.39%  | ±0.48% -73.48%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.453mb +0.00% | 54.851ms +1.79%  | ±1.12% +160.09% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.662mb +0.00% | 1.253s -0.05%    | ±1.82% -35.00%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.747mb +0.00%  | 40.036ms -2.29%  | ±0.55% -27.41%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.388mb +0.00%  | 327.320ms +0.23% | ±2.18% +96.71%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.311mb +0.00%  | 65.224ms -1.19%  | ±1.77% +51.03%  |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.443mb +0.00%  | 2.649ms +0.40%   | ±1.06% +157.85% |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.236mb +0.00%  | 181.434ms +1.12% | ±1.20% +33.21%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.762mb +0.00%  | 17.961ms -1.10%  | ±0.43% -21.22%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.683mb +0.00%  | 1.650ms +3.74%   | ±1.06% +18.24%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.683mb +0.00%  | 1.736ms +10.19%  | ±1.89% +81.66%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.796mb +0.00%  | 2.527ms +1.36%   | ±0.90% +42.81%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.324mb +0.00%  | 14.070ms +0.71%  | ±0.95% +71.20%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.324mb +0.00%  | 14.606ms +4.73%  | ±1.22% +216.03% |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.227mb +0.00%  | 1.594μs -6.57%   | ±3.01% +10.64%  |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.227mb +0.00%  | 0.400μs +33.33%  | ±0.00% +0.00%   |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.784mb +0.00%  | 12.636ms +1.18%  | ±1.69% -49.11%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.144mb +0.00% | 62.645ms -2.10%  | ±1.49% +194.46% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.845mb +0.00%  | 1.934ms +20.76%  | ±1.49% -52.16%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 78.118mb +0.00%  | 34.113ms +2.63%  | ±0.51% -55.84%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.946mb +0.00%  | 4.081ms +7.71%   | ±1.23% +314.54% |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.373mb +0.00%  | 39.845ms +2.13%  | ±0.84% -9.53%   |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.373mb +0.00%  | 40.428ms +3.75%  | ±1.55% -2.25%   |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.373mb +0.00%  | 40.743ms +3.88%  | ±1.13% -51.31%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.670mb +0.00%  | 7.384ms -0.35%   | ±0.29% -80.22%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.227mb +0.00%  | 28.899ms +0.92%  | ±1.22% +294.42% |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.227mb +0.00%  | 13.300μs +3.10%  | ±0.61% -3.01%   |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.227mb +0.00%  | 15.781μs +0.44%  | ±3.55% +493.67% |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.238mb +0.00%  | 180.887ms +0.49% | ±0.38% -8.77%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.986mb +0.00% | 382.383ms +0.38% | ±1.45% +86.06%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.704mb +0.00%  | 193.675ms +3.42% | ±0.64% -56.12%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.829mb +0.00%  | 40.077ms +0.34%  | ±1.08% +49.44%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 2f7564d into flow-php:1.x Dec 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant