Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

Changed

  • Updated dependencies

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev         |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.101mb +0.01%  | 704.545ms -1.31% | ±2.46% +2.03%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.800mb +0.08%   | 303.054ms +0.26% | ±0.38% -41.45% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.898mb +0.10%   | 926.989ms -0.33% | ±1.32% -33.47% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.604mb +0.00% | 1.100s -2.66%    | ±0.24% -75.29% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.677mb +0.07%   | 24.957ms -0.29%  | ±0.11% -91.18% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.679mb +0.07%   | 406.010ms +0.11% | ±0.31% -83.24% |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev        |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.365mb +0.00% | 62.558ms -0.30% | ±0.85% -7.88% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.762mb +0.00%  | 443.047ms -8.09% | ±2.49% +42.07%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.840mb +0.01%  | 72.168ms +0.71%  | ±0.55% -35.74%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.356mb +0.00% | 56.467ms -0.88%  | ±2.39% +816.74% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.567mb +0.00% | 1.500s -2.03%    | ±2.97% +95.53%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.717mb +0.02%  | 42.462ms +2.68%  | ±0.03% -96.66%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.415mb +0.00%  | 2.911ms -5.06%   | ±3.44% +106.29% |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.208mb +0.00%  | 182.036ms -2.06% | ±0.93% -5.26%   |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.734mb +0.00%  | 18.317ms -1.55%  | ±0.52% -36.75%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.655mb +0.00%  | 1.884ms +10.91%  | ±1.07% -65.34%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.655mb +0.00%  | 1.825ms +13.33%  | ±2.12% +62.29%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.767mb +0.00%  | 2.551ms -12.17%  | ±3.29% +29.17%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.296mb +0.00%  | 14.169ms -4.73%  | ±1.29% +214.52% |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.296mb +0.00%  | 14.482ms -0.47%  | ±0.92% -10.46%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.199mb +0.00%  | 1.794μs -10.03%  | ±2.67% +11.32%  |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.199mb +0.00%  | 0.300μs -25.00%  | ±0.00% -100.00% |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.756mb +0.00%  | 13.517ms -4.96%  | ±1.20% -36.00%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.115mb +0.00% | 64.264ms -2.65%  | ±1.68% -22.44%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.817mb +0.00%  | 1.820ms +7.76%   | ±1.30% -40.83%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 78.090mb +0.00%  | 34.523ms -1.29%  | ±1.52% +414.81% |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.917mb +0.00%  | 3.878ms -5.17%   | ±1.11% -23.49%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.344mb +0.00%  | 39.217ms +1.01%  | ±1.05% +67.21%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.345mb +0.00%  | 40.018ms +1.53%  | ±0.69% -49.22%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.344mb +0.00%  | 39.669ms -1.51%  | ±1.08% +8.97%   |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.641mb +0.00%  | 7.387ms +0.38%   | ±0.66% -52.28%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.199mb +0.00%  | 29.052ms -2.39%  | ±0.55% -61.92%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.199mb +0.00%  | 13.835μs +3.30%  | ±2.99% +31.04%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.199mb +0.00%  | 15.983μs +0.31%  | ±1.34% +3.61%   |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.209mb +0.00%  | 186.699ms +2.06% | ±0.31% -50.84%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.360mb +0.01%  | 333.209ms +1.12% | ±1.43% -46.17%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.283mb +0.02%  | 65.773ms +0.52%  | ±2.30% +174.53% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.957mb +0.00% | 384.081ms -0.24% | ±1.54% +208.87% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.675mb +0.01%  | 195.514ms +1.47% | ±0.58% -47.48%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.800mb +0.03%  | 40.104ms -3.68%  | ±0.55% -71.74%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 6e9e179 into flow-php:1.x Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant