Skip to content

Conversation

@stloyd
Copy link
Member

@stloyd stloyd commented Nov 20, 2023

Change Log

Added

  • Add `TypeDetectorBench`

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 34.745mb +0.00%  | 1.151s -0.76%    | ±0.47% -65.74%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.603mb +0.01%   | 304.230ms -0.43% | ±2.02% +389.02% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.769mb +0.01%   | 1.401s +1.32%    | ±1.98% +150.75% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.473mb +0.00% | 1.591s -0.04%    | ±0.18% -63.86%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.558mb +0.01%   | 24.288ms -3.45%  | ±1.79% +5.68%   |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.558mb +0.01%   | 406.700ms -0.75% | ±0.42% -52.15%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.244mb +0.00% | 64.889ms -3.40% | ±2.12% +20.29% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev         |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.725mb +0.00%  | 439.699ms -1.75% | ±0.81% -67.74% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.709mb +0.00%  | 71.238ms -0.48%  | ±1.47% +17.62% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.307mb +0.00% | 55.373ms -3.59%  | ±0.77% +37.00% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.781mb +0.00% | 1.432s -1.74%    | ±0.15% -46.84% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.587mb +0.00%  | 42.267ms +1.70%  | ±0.23% -74.35% |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.292mb         | 2.409ms          | ±2.90%          |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.082mb         | 184.858ms        | ±0.48%          |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.608mb         | 18.572ms         | ±0.30%          |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 75.431mb         | 1.853ms          | ±3.03%          |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 75.431mb         | 1.860ms          | ±3.61%          |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.644mb         | 2.784ms          | ±3.21%          |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.173mb         | 16.430ms         | ±1.40%          |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.173mb         | 16.419ms         | ±1.20%          |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.076mb         | 1.906μs          | ±2.44%          |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.076mb         | 0.400μs          | ±0.00%          |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.633mb         | 14.032ms         | ±0.70%          |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 115.992mb        | 64.291ms         | ±1.10%          |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.693mb         | 1.986ms          | ±3.41%          |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 77.961mb         | 35.075ms         | ±0.52%          |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.794mb         | 4.627ms          | ±1.57%          |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.219mb         | 38.913ms         | ±3.41%          |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.219mb         | 38.517ms         | ±0.52%          |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.219mb         | 38.953ms         | ±1.70%          |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.518mb         | 7.346ms          | ±0.59%          |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.076mb         | 28.702ms         | ±0.13%          |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.076mb         | 13.301μs         | ±3.07%          |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.076mb         | 16.194μs         | ±0.29%          |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.084mb         | 184.765ms        | ±0.44%          |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 98.213mb         | 954.716ms        | ±1.90%          |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 21.904mb         | 191.561ms        | ±0.08%          |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.835mb +0.00% | 767.193ms -3.45% | ±0.75% +103.71% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.554mb +0.00%  | 386.553ms -2.77% | ±0.73% +48.39%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.676mb +0.00%  | 80.964ms -0.65%  | ±0.65% -18.69%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 4f3a9dd into flow-php:1.x Nov 20, 2023
@stloyd stloyd deleted the chore/type-bench branch November 20, 2023 18:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants