Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • DataFrame::collectRefs()

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 34.760mb +0.01%  | 692.641ms +1.47% | ±0.25% -92.95%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.625mb +0.07%   | 297.540ms +0.98% | ±0.09% -68.72%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.784mb +0.07%   | 915.230ms +0.02% | ±0.22% +101.20% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.494mb +0.00% | 1.096s -0.41%    | ±0.10% -61.85%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.563mb +0.08%   | 23.992ms +1.34%  | ±1.30% +146.83% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.563mb +0.08%   | 410.748ms +1.84% | ±0.63% -29.79%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.248mb +0.00% | 61.582ms -1.53% | ±2.00% -19.00% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.421mb +0.00%  | 446.986ms +0.06% | ±0.77% -35.72%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.730mb +0.01%  | 71.887ms +1.89%  | ±0.14% -70.24%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.002mb +0.00% | 55.372ms -0.63%  | ±0.37% -41.20%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.481mb +0.00% | 1.474s -0.92%    | ±0.82% +137.89% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.604mb +0.02%  | 41.505ms +1.16%  | ±0.13% -95.25%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.301mb +0.00%  | 2.653ms -9.32%   | ±1.26% +59.90%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.092mb +0.00%  | 178.099ms +1.20% | ±0.47% -48.79%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.618mb +0.00%  | 17.673ms +1.52%  | ±0.48% -17.10%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.541mb +0.00%  | 1.627ms -19.75%  | ±0.10% -96.73%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.541mb +0.00%  | 1.590ms -16.79%  | ±0.99% -0.30%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.653mb +0.00%  | 2.525ms -8.49%   | ±0.72% -36.48%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.182mb +0.00%  | 14.230ms -1.13%  | ±1.55% +56.15%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.182mb +0.00%  | 14.450ms -0.69%  | ±0.35% -77.93%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.085mb +0.00%  | 1.794μs -0.67%   | ±2.67% +3.77%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.085mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.642mb +0.00%  | 12.686ms +4.88%  | ±1.94% +441.97% |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.001mb +0.00% | 62.683ms +0.69%  | ±0.58% +374.56% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.703mb +0.00%  | 1.746ms -17.47%  | ±0.37% -82.49%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 77.970mb +0.00%  | 32.999ms -1.31%  | ±0.23% -63.69%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.803mb +0.00%  | 3.795ms -5.14%   | ±0.68% -76.92%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.228mb +0.00%  | 38.675ms -0.33%  | ±0.16% +24.88%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.229mb +0.00%  | 38.641ms -0.37%  | ±1.63% +160.40% |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.228mb +0.00%  | 39.369ms +1.93%  | ±1.69% +185.37% |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.528mb +0.00%  | 7.423ms -0.08%   | ±1.33% +93.14%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.085mb +0.00%  | 28.687ms -0.41%  | ±0.22% -74.98%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.085mb +0.00%  | 13.294μs -1.44%  | ±0.36% -49.37%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.085mb +0.00%  | 15.883μs -3.42%  | ±1.35% -50.86%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.093mb +0.00%  | 182.753ms +1.18% | ±0.47% -60.92%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.174mb +0.00%  | 330.304ms +0.20% | ±1.18% +280.91% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.097mb +0.01%  | 64.830ms -0.23%  | ±0.48% +3.25%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.844mb +0.00% | 369.876ms -0.43% | ±0.25% -71.37%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.562mb +0.00%  | 188.475ms +0.79% | ±1.82% +116.11% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.687mb +0.01%  | 39.470ms -1.75%  | ±0.75% +16.39%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 7745791 into flow-php:1.x Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant