Skip to content

Conversation

@stloyd
Copy link
Member

@stloyd stloyd commented Feb 2, 2024

Change Log

Added

Fixed

Changed

  • Hide data in `ArrayMemory` by default

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

github-actions bot commented Feb 2, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev           |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.264mb +0.00%  | 825.437ms -0.07% | ±0.68% -9.91%    |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.984mb +0.00%   | 341.965ms +0.34% | ±2.33% +4167.50% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 5.134mb +0.00%   | 1.049s -1.43%    | ±0.50% -46.84%   |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.838mb +0.00% | 1.258s +0.97%    | ±0.62% -40.26%   |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.903mb +0.00%   | 35.059ms -0.03%  | ±0.59% -6.50%    |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.904mb +0.00%   | 437.999ms +0.52% | ±0.87% -33.82%   |
+-----------------------+-------------------+------+-----+------------------+------------------+------------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev          |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.604mb +0.00% | 65.088ms +0.04% | ±1.60% +129.34% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 95.645mb +0.00%  | 463.804ms -0.14% | ±0.29% -70.06%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.120mb +0.00%  | 71.929ms -2.77%  | ±0.40% -51.65%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 106.549mb +0.00% | 52.464ms +1.61%  | ±1.95% +169.59% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 321.760mb +0.00% | 1.483s -1.07%    | ±0.35% -81.32%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.943mb +0.00%  | 40.590ms -2.14%  | ±1.03% +51.52%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.710mb +0.00% | 500.527ms +1.70% | ±0.67% -7.05%   |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 60.189mb +0.00%  | 251.773ms +3.48% | ±0.82% -51.87%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 15.122mb +0.00%  | 53.035ms +2.59%  | ±2.37% +14.49%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.961mb +0.00%  | 434.341ms +0.67% | ±0.49% -47.03%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.500mb +0.00%  | 87.558ms +0.68%  | ±2.91% +281.32% |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.679mb +0.00%  | 3.590ms +6.16%   | ±0.30% -82.56%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.406mb +0.00%  | 181.276ms -2.54% | ±0.64% -53.43%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.931mb +0.00%  | 18.273ms -0.97%  | ±0.94% -17.82%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.919mb +0.00%  | 1.714ms -0.65%   | ±1.27% -47.46%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.919mb +0.00%  | 1.752ms +2.03%   | ±1.09% -45.08%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 75.031mb +0.00%  | 2.571ms +1.31%   | ±1.73% -17.52%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.560mb +0.00%  | 14.632ms +2.59%  | ±0.74% -62.69%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.560mb +0.00%  | 14.478ms -0.72%  | ±1.71% +44.72%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.464mb +0.00%  | 1.706μs +0.72%   | ±2.72% -3.85%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.464mb +0.00%  | 0.400μs +33.33%  | ±0.00% +0.00%   |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 87.018mb +0.00%  | 12.936ms -4.68%  | ±2.16% -30.83%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.379mb +0.00% | 64.323ms +0.97%  | ±1.21% +115.85% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 76.079mb +0.00%  | 1.412ms +13.46%  | ±3.78% +20.05%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.426mb +0.00%  | 57.897ms -1.12%  | ±0.62% -72.81%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 78.181mb +0.00%  | 3.947ms -5.03%   | ±0.33% -89.12%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.542mb +0.00%  | 40.491ms +0.26%  | ±1.29% +127.27% |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.543mb +0.00%  | 40.399ms +0.12%  | ±0.07% -92.67%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.542mb +0.00%  | 40.587ms -0.64%  | ±0.22% -88.29%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.905mb +0.00%  | 7.463ms +1.71%   | ±1.04% +659.66% |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.464mb +0.00%  | 30.338ms +5.22%  | ±1.65% -8.57%   |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.464mb +0.00%  | 13.379μs +0.72%  | ±0.93% -42.41%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.464mb +0.00%  | 15.800μs -0.89%  | ±0.52% -72.26%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.407mb +0.00%  | 186.096ms -1.76% | ±0.96% +17.44%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@stloyd stloyd force-pushed the bugfix/array-memory branch from eaccced to 62a4664 Compare February 2, 2024 13:13
@github-actions github-actions bot added size: S and removed size: XS labels Feb 2, 2024
@norberttech norberttech merged commit e22b300 into flow-php:1.x Feb 2, 2024
@stloyd stloyd deleted the bugfix/array-memory branch February 2, 2024 13:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants