Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • Allow to pass schema to doctrine dbal extractors
  • Database data source example to website
  • Database data sink example to website

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

github-actions bot commented Dec 13, 2024

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev         |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.695mb +0.11%   | 515.758ms -0.04% | ±0.28% +9.50%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.798mb +0.11%   | 1.096s -0.73%    | ±1.24% -11.67% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 102.507mb +0.00% | 989.395ms +3.25% | ±1.62% +40.25% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.424mb +0.11%   | 33.303ms -2.35%  | ±0.37% -64.73% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.405mb +0.11%   | 671.130ms -2.01% | ±0.88% -53.43% |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 116.700mb +0.00% | 60.570ms -2.31% | ±0.09% -91.49% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.892mb +0.01%  | 113.688ms +0.23% | ±0.99% +112.35% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 90.420mb +0.01%  | 106.191ms -1.41% | ±1.15% -16.20%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 255.378mb +0.00% | 22.605s -0.22%   | ±0.60% -37.03%  |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.614mb +0.03%  | 44.732ms +0.43%  | ±0.24% -50.81%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 87.513mb +0.01%  | 3.854ms +4.93%   | ±0.51% -78.66%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 103.050mb +0.00% | 194.622ms +1.00% | ±0.55% -14.29%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 85.770mb +0.01%  | 19.617ms +1.41%  | ±0.29% +652.43% |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 88.752mb +0.01%  | 2.119ms -11.71%  | ±2.51% -28.65%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 88.752mb +0.01%  | 2.208ms -7.29%   | ±1.98% -14.05%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 85.865mb +0.01%  | 3.211ms +11.77%  | ±2.22% -20.47%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 86.394mb +0.01%  | 17.610ms +6.51%  | ±2.36% +10.85%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 86.394mb +0.01%  | 17.739ms +2.54%  | ±1.49% -27.59%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 84.298mb +0.01%  | 2.000μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 84.298mb +0.01%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 93.648mb +0.01%  | 14.201ms -3.16%  | ±0.77% -72.77%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 123.018mb +0.00% | 63.670ms -1.90%  | ±1.23% -10.20%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 86.913mb +0.01%  | 1.847ms +4.87%   | ±2.31% -42.35%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 90.203mb +0.01%  | 62.489ms -0.09%  | ±1.33% -8.81%   |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 89.015mb +0.01%  | 4.842ms -5.39%   | ±1.82% +23.56%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 84.381mb +0.01%  | 41.246ms +0.75%  | ±1.96% -24.64%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 84.382mb +0.01%  | 42.353ms -0.36%  | ±1.16% +107.64% |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 84.381mb +0.01%  | 41.140ms -1.71%  | ±1.45% -40.03%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 86.739mb +0.01%  | 7.836ms +4.30%   | ±0.94% +38.67%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 84.298mb +0.01%  | 30.733ms +1.10%  | ±0.80% +40.90%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 84.298mb +0.01%  | 13.980μs +1.39%  | ±1.21% +76.01%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 84.298mb +0.01%  | 16.688μs +1.72%  | ±0.57% +97.60%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 103.052mb +0.00% | 201.282ms +4.26% | ±0.49% -29.85%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 53.235mb +0.13%  | 395.085ms -0.88% | ±2.39% +264.33% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 13.501mb +0.52%  | 80.493ms -0.20%  | ±0.44% -76.43%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 107.538mb +0.00% | 481.153ms +0.98% | ±1.74% +23.18%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 55.896mb +0.01%  | 243.502ms -0.93% | ±0.24% -75.95%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.734mb +0.03%  | 52.129ms -5.89%  | ±0.64% -20.05%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 9c4245a into flow-php:1.x Dec 13, 2024
33 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant