Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • Added CLI command to read schema from a file

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

github-actions bot commented Oct 11, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.599mb +0.06%  | 517.055ms +0.64% | ±1.08% +164.35% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.687mb +0.06%  | 1.092s +1.34%    | ±0.58% +2.38%   |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 29.143mb +0.01% | 429.167ms -2.53% | ±0.80% -19.95%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.328mb +0.06%  | 34.288ms +2.02%  | ±2.11% +61.34%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.309mb +0.06%  | 653.778ms -3.67% | ±0.25% -83.01%  |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 116.603mb +0.00% | 59.849ms +0.31% | ±0.33% -88.12% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.797mb +0.01%  | 138.139ms -1.53% | ±0.45% +6.11%   |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 90.380mb +0.00%  | 115.819ms -1.84% | ±0.69% +383.69% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 124.434mb +0.00% | 1.229s -0.52%    | ±0.28% +430.16% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.518mb +0.02%  | 42.760ms -4.69%  | ±0.09% -96.94%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 87.353mb +0.00%  | 3.354ms -2.97%   | ±1.29% -28.28%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 102.957mb +0.00% | 188.045ms +1.93% | ±0.97% +87.07%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 85.677mb +0.00%  | 19.414ms +5.27%  | ±1.18% +79.10%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 88.593mb +0.00%  | 1.644ms -8.14%   | ±1.12% -41.35%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 88.593mb +0.00%  | 1.634ms -11.36%  | ±1.00% -65.78%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 85.705mb +0.00%  | 2.701ms -8.91%   | ±0.47% -82.06%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 86.234mb +0.00%  | 14.983ms -10.49% | ±2.45% +201.47% |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 86.234mb +0.00%  | 14.673ms -11.51% | ±1.58% -20.10%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 84.138mb +0.00%  | 1.800μs -0.34%   | ±0.00% -100.00% |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 84.138mb +0.00%  | 0.300μs -25.00%  | ±0.00% -100.00% |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 93.488mb +0.00%  | 12.624ms -0.21%  | ±0.72% -9.53%   |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 122.859mb +0.00% | 62.115ms +2.06%  | ±0.60% +63.47%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 86.754mb +0.00%  | 1.393ms -10.02%  | ±1.37% -10.71%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 90.106mb +0.00%  | 63.022ms -1.92%  | ±1.04% +16.26%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 88.855mb +0.00%  | 4.148ms -4.80%   | ±0.12% -87.30%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 84.287mb +0.00%  | 39.835ms -0.94%  | ±0.67% +62.37%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 84.288mb +0.00%  | 40.028ms -1.40%  | ±0.32% -61.72%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 84.287mb +0.00%  | 40.160ms +0.08%  | ±0.87% +202.00% |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 86.580mb +0.00%  | 7.438ms -0.40%   | ±0.71% -13.21%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 84.138mb +0.00%  | 29.118ms -0.86%  | ±0.22% -81.27%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 84.138mb +0.00%  | 13.330μs -3.11%  | ±1.75% -2.70%   |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 84.138mb +0.00%  | 15.860μs -0.44%  | ±1.80% +22.67%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 102.958mb +0.00% | 190.710ms +0.20% | ±0.85% +35.65%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 53.180mb +0.00%  | 399.939ms +0.93% | ±0.57% +116.34% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 13.445mb +0.01%  | 80.556ms -1.09%  | ±1.78% +11.00%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 107.442mb +0.00% | 481.062ms +1.46% | ±0.98% +50.38%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 55.800mb +0.00%  | 241.096ms -0.18% | ±0.83% +216.58% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.638mb +0.01%  | 52.315ms +0.10%  | ±0.22% -84.34%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 2c34a94 into flow-php:1.x Oct 11, 2024
@norberttech norberttech deleted the feature/file-schema-cli-command branch December 5, 2024 20:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant