Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

  • changing partitions order during partitioning

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

github-actions bot commented Jan 2, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.129mb -0.00%  | 745.162ms -2.25% | ±0.78% +120.95% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.782mb +0.00%   | 341.688ms -0.65% | ±0.56% +82.07%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.877mb +0.00%   | 972.579ms -0.55% | ±0.53% -50.73%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.581mb +0.00% | 1.146s -2.17%    | ±0.64% -20.62%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.661mb +0.01%   | 54.453ms -5.35%  | ±0.80% +9.54%   |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.663mb +0.01%   | 457.323ms -4.33% | ±0.38% -79.91%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.376mb -0.00% | 64.154ms -1.42% | ±0.24% -69.84% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.739mb -0.00%  | 463.697ms +1.82% | ±0.19% -78.73%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.820mb +0.00%  | 72.229ms -6.11%  | ±0.28% -89.76%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.333mb +0.00% | 58.237ms -2.83%  | ±0.63% +3.92%   |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.544mb -0.00% | 1.268s -1.31%    | ±0.36% -52.08%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.703mb +0.00%  | 41.164ms -0.72%  | ±2.24% +632.53% |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.992mb -0.00% | 390.601ms +0.87% | ±1.05% -42.86%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.710mb -0.00%  | 199.702ms +0.58% | ±0.94% +94.60%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.835mb +0.00%  | 41.992ms -1.61%  | ±1.28% -14.27%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.398mb +0.00%  | 328.896ms -1.91% | ±0.59% +51.71%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.321mb +0.00%  | 65.032ms -3.25%  | ±0.96% -25.05%  |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.457mb -0.00%  | 3.471ms -17.75%  | ±2.10% +67.75%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.249mb -0.00%  | 183.445ms +0.54% | ±2.70% +237.63% |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.775mb -0.00%  | 18.407ms +0.11%  | ±0.37% -68.77%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.697mb -0.00%  | 1.964ms +5.80%   | ±2.13% +379.42% |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.697mb -0.00%  | 1.902ms +4.36%   | ±3.21% +796.98% |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.808mb +0.00%  | 2.752ms -2.70%   | ±0.86% +43.73%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.338mb -0.00%  | 15.388ms -0.91%  | ±1.25% -30.48%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.338mb -0.00%  | 15.032ms -1.10%  | ±1.50% +47.73%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.240mb -0.00%  | 1.894μs -0.64%   | ±2.53% +3.57%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.240mb -0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.796mb -0.00%  | 13.012ms -4.30%  | ±1.77% -20.93%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.157mb -0.00% | 63.555ms -3.07%  | ±1.25% +123.27% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.857mb -0.00%  | 1.407ms -12.32%  | ±2.39% +11.97%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.204mb +0.00%  | 60.173ms +1.13%  | ±1.07% -18.74%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.959mb -0.00%  | 4.287ms +1.26%   | ±3.22% +182.26% |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.386mb -0.00%  | 40.122ms +0.22%  | ±0.84% -24.05%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.386mb -0.00%  | 40.575ms -0.69%  | ±0.20% -87.76%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.386mb -0.00%  | 40.386ms -2.51%  | ±2.90% +74.62%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.683mb -0.00%  | 7.482ms -0.88%   | ±1.22% +140.53% |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.241mb -0.00%  | 29.078ms -2.61%  | ±0.19% -55.25%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.240mb -0.00%  | 13.788μs -2.36%  | ±0.69% -22.57%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.240mb -0.00%  | 15.930μs -3.57%  | ±1.47% +41.84%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.251mb -0.00%  | 184.923ms +0.05% | ±0.21% -42.29%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 9c1983b into flow-php:1.x Jan 2, 2024
@norberttech norberttech deleted the bug/partition-by-order branch December 5, 2024 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant