Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

Fixed

  • overwriting pivot columns

Changed

Removed

Deprecated

Security


Description

Refs: #510

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 34.760mb +0.00%  | 687.628ms +0.94% | ±0.73% +6.36%   |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.625mb +0.01%   | 297.832ms +0.39% | ±0.49% +72.62%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.784mb +0.01%   | 921.873ms +0.40% | ±2.27% +161.46% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.494mb +0.00% | 1.103s +1.55%    | ±0.77% +186.78% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.563mb +0.01%   | 24.074ms -0.24%  | ±3.11% +84.77%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.563mb +0.01%   | 409.032ms -1.97% | ±0.88% -66.73%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.248mb +0.00% | 64.142ms +1.29% | ±0.16% -94.20% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.420mb +0.00%  | 445.782ms +1.42% | ±0.94% +20.21%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.730mb +0.00%  | 72.548ms +3.50%  | ±0.96% +346.50% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.002mb +0.00% | 57.670ms +6.24%  | ±0.94% -23.32%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.481mb +0.00% | 1.497s +1.57%    | ±0.28% -78.84%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.604mb +0.00%  | 40.969ms +0.02%  | ±0.77% +226.01% |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev           |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.301mb +0.00%  | 3.086ms +17.99%  | ±1.40% +545.22%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.092mb +0.00%  | 178.181ms +1.08% | ±0.54% +65.93%   |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.618mb +0.00%  | 17.814ms +2.03%  | ±0.51% -20.69%   |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.541mb +0.00%  | 2.025ms +23.32%  | ±3.14% +873.37%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.541mb +0.00%  | 1.959ms +20.72%  | ±1.40% -4.52%    |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.653mb +0.00%  | 2.958ms +20.03%  | ±0.14% -93.64%   |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.182mb +0.00%  | 17.373ms +22.80% | ±1.07% -31.33%   |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.182mb +0.00%  | 17.574ms +25.57% | ±0.65% -60.65%   |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.085mb +0.00%  | 1.906μs +5.54%   | ±2.44% -5.17%    |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.085mb +0.00%  | 0.400μs +100.00% | ±0.00% 0.00%     |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.642mb +0.00%  | 14.256ms +18.03% | ±1.39% +7.23%    |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.001mb +0.00% | 64.830ms +3.74%  | ±1.13% +18.79%   |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.703mb +0.00%  | 2.054ms +14.78%  | ±0.88% -48.90%   |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 77.970mb +0.00%  | 39.201ms +20.97% | ±1.71% +148.73%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.803mb +0.00%  | 4.377ms +14.60%  | ±1.61% -5.88%    |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.228mb +0.00%  | 38.515ms +1.28%  | ±0.95% -27.77%   |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.229mb +0.00%  | 38.859ms +1.49%  | ±2.26% +218.03%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.228mb +0.00%  | 39.386ms +2.06%  | ±1.38% +6.49%    |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.527mb +0.00%  | 7.897ms +7.30%   | ±3.05% +1072.15% |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.085mb +0.00%  | 29.985ms +5.55%  | ±2.42% -31.55%   |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.085mb +0.00%  | 13.800μs +3.52%  | ±0.00% -100.00%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.085mb +0.00%  | 16.812μs +5.73%  | ±1.57% +53.33%   |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.093mb +0.00%  | 180.498ms +1.42% | ±0.58% -48.61%   |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.174mb +0.00%  | 332.199ms +1.66% | ±1.46% +100.69%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.097mb +0.00%  | 66.180ms +2.94%  | ±1.70% +2497.23% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.844mb +0.00% | 378.769ms +2.32% | ±0.40% +70.92%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.562mb +0.00%  | 188.406ms +2.27% | ±1.32% +165.06%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.687mb +0.00%  | 40.342ms +1.90%  | ±3.00% +478.83%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+------------------+

@norberttech norberttech merged commit ede3307 into flow-php:1.x Nov 23, 2023
@norberttech norberttech deleted the bug/pivot-pivot-columns branch December 5, 2024 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant