Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • pivoting datasets

Fixed

Changed

Removed

Deprecated

Security


Description

Closes: #510

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 34.759mb +0.00%  | 689.164ms +0.90% | ±0.66% +49.42%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.624mb +0.02%   | 295.656ms -0.77% | ±2.13% +748.01% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.783mb +0.02%   | 910.250ms -0.81% | ±0.34% -62.00%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.493mb +0.00% | 1.095s -1.28%    | ±0.97% +113.42% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.562mb +0.02%   | 24.301ms -1.51%  | ±1.38% +28.99%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.563mb +0.02%   | 404.002ms -1.22% | ±0.20% -36.67%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev          |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.247mb +0.00% | 62.377ms -0.85% | ±2.34% +233.29% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.420mb +0.00%  | 439.139ms -1.85% | ±3.34% +549.39% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.729mb +0.00%  | 71.710ms -0.48%  | ±1.73% +608.54% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.002mb +0.00% | 56.073ms -0.26%  | ±1.68% +118.54% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.480mb +0.00% | 1.465s -4.60%    | ±0.38% -62.98%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.604mb +0.01%  | 41.072ms -1.10%  | ±1.13% -56.39%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.301mb +0.00%  | 2.775ms -10.19%  | ±3.13% +45.67%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.092mb +0.00%  | 178.085ms +0.44% | ±0.10% -48.72%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.618mb +0.00%  | 17.966ms +0.68%  | ±1.59% +32.64%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.541mb +0.00%  | 1.700ms -6.98%   | ±0.16% -90.82%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.541mb +0.00%  | 1.692ms -13.42%  | ±1.87% -31.20%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.653mb +0.00%  | 2.614ms -10.67%  | ±3.43% +92.38%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.182mb +0.00%  | 14.412ms -1.28%  | ±0.97% +188.90% |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.182mb +0.00%  | 14.137ms -3.66%  | ±0.41% -45.38%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.085mb +0.00%  | 1.606μs -19.94%  | ±2.89% +24.49%  |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.085mb +0.00%  | 0.200μs -50.00%  | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.642mb +0.00%  | 12.365ms -6.03%  | ±1.11% -60.28%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.001mb +0.00% | 62.697ms -4.75%  | ±3.41% +113.96% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.703mb +0.00%  | 1.825ms -2.94%   | ±2.24% +107.56% |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 77.969mb +0.00%  | 33.048ms -2.91%  | ±0.36% -68.23%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.803mb +0.00%  | 3.954ms -3.59%   | ±2.33% -12.14%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.228mb +0.00%  | 38.345ms -2.25%  | ±1.56% +40.54%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.229mb +0.00%  | 39.145ms +1.21%  | ±1.77% +1.53%   |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.228mb +0.00%  | 38.570ms -0.53%  | ±0.39% -46.98%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.528mb +0.00%  | 7.334ms -0.02%   | ±0.48% -72.21%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.085mb +0.00%  | 28.452ms -0.13%  | ±0.09% -95.38%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.085mb +0.00%  | 13.372μs -0.70%  | ±3.51% +131.12% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.085mb +0.00%  | 15.806μs -0.74%  | ±0.30% -74.68%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.093mb +0.00%  | 183.379ms +0.41% | ±0.42% -61.32%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.174mb +0.00%  | 324.657ms -1.66% | ±1.01% +39.57%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.097mb +0.00%  | 63.842ms -2.41%  | ±1.10% +329.71% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.844mb +0.00% | 382.672ms +1.60% | ±2.06% +137.07% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.562mb +0.00%  | 186.622ms -0.48% | ±0.18% -85.70%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.687mb +0.00%  | 39.508ms -2.71%  | ±0.72% -64.44%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 6a76d68 into flow-php:1.x Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Pivoting

1 participant