Skip to content

Conversation

@norberttech
Copy link
Member

@norberttech norberttech commented Dec 27, 2024

Change Log

Added

Fixed

Changed

  • Split test suite into independent jobs
  • Locked meilisearch to 1.11

Removed

Deprecated

Security


Description

Resolves: #1284

@github-actions
Copy link
Contributor

github-actions bot commented Dec 27, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.707mb +0.01%   | 515.255ms +0.04% | ±1.32% +957.56% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.810mb +0.01%   | 1.099s +0.75%    | ±0.46% -38.73%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 102.528mb +0.00% | 936.926ms -1.44% | ±1.05% +24.99%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.435mb +0.01%   | 33.426ms +0.41%  | ±1.43% +61.29%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.413mb +0.01%   | 668.401ms +0.03% | ±0.25% -7.80%   |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 117.578mb +0.00% | 63.039ms +3.18% | ±0.95% +55.33% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 55.703mb +0.00%  | 114.789ms +1.46% | ±1.78% +106.75% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 90.910mb +0.00%  | 106.155ms -1.19% | ±0.82% -30.99%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 255.717mb +0.00% | 22.318s -0.47%   | ±0.13% -91.89%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.784mb +0.00%  | 44.529ms -0.21%  | ±0.13% -81.53%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev                       |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 88.404mb +0.00%  | 3.411ms -1.62%   | ±3.56% +59.52%               |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 103.942mb +0.00% | 203.333ms +8.44% | ±1.51% +260.85%              |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 86.662mb +0.00%  | 19.669ms +5.80%  | ±0.43% -22.96%               |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 89.644mb +0.00%  | 1.778ms -3.86%   | ±2.25% +119.67%              |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 89.644mb +0.00%  | 1.749ms -7.20%   | ±0.92% -68.83%               |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 86.756mb +0.00%  | 2.573ms -6.30%   | ±0.42% -80.17%               |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 87.285mb +0.00%  | 14.458ms +0.14%  | ±1.96% +64.84%               |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 87.285mb +0.00%  | 14.541ms -0.38%  | ±1.66% -8.85%                |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 85.190mb +0.00%  | 1.600μs -15.52%  | ±0.00% -100.00%              |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 85.190mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%                 |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 94.700mb +0.00%  | 12.471ms -1.53%  | ±0.49% -31.84%               |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 123.910mb +0.00% | 61.557ms -0.29%  | ±1.91% +144.75%              |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 87.805mb +0.00%  | 1.356ms -0.31%   | ±0.79% -32.37%               |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 91.095mb +0.00%  | 60.783ms -1.24%  | ±0.94% -18.30%               |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 89.906mb +0.00%  | 4.000ms -2.04%   | ±1.78% -36.61%               |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 85.273mb +0.00%  | 43.379ms +4.07%  | ±1.12% -2.64%                |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 85.274mb +0.00%  | 39.930ms -12.27% | ±2.02% +129.45%              |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 85.273mb +0.00%  | 41.719ms +0.74%  | ±0.88% -0.42%                |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 87.631mb +0.00%  | 7.457ms -2.45%   | ±0.95% -66.97%               |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 85.190mb +0.00%  | 28.645ms +0.36%  | ±0.80% -37.55%               |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 85.190mb +0.00%  | 13.294μs -3.67%  | ±0.36% +2760455812840900.00% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 85.190mb +0.00%  | 15.800μs -1.76%  | ±0.52% -61.25%               |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 103.943mb +0.00% | 196.283ms +1.15% | ±0.64% -66.16%               |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 53.308mb +0.00%  | 399.994ms +0.68% | ±1.33% +90.74%               |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 13.574mb +0.00%  | 78.901ms -0.65%  | ±1.80% +31.68%               |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 108.029mb +0.00% | 481.226ms +1.54% | ±1.22% -31.88%               |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 56.147mb +0.00%  | 240.547ms +0.79% | ±1.30% +15.27%               |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.794mb +0.00%  | 52.439ms -1.29%  | ±3.58% +1530.90%             |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------------------+

@norberttech norberttech merged commit f83f6fc into flow-php:1.x Dec 27, 2024
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Split test suite into independent jobs

1 participant