Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • Parquet documentation

Fixed

Changed

Removed

Deprecated

Security


Description

@norberttech norberttech merged commit b06554f into flow-php:1.x Jan 29, 2024
@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.260mb +0.00%  | 818.681ms -0.58% | ±2.69% +257.28% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.978mb +0.00%   | 342.076ms -0.01% | ±0.56% +61.60%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 5.130mb +0.00%   | 1.047s +0.76%    | ±1.29% +1.90%   |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.833mb +0.00% | 1.266s +1.07%    | ±1.30% +365.15% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.898mb +0.00%   | 35.507ms -0.45%  | ±0.41% -59.84%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.900mb +0.00%   | 438.761ms +0.60% | ±0.75% +88.82%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.600mb +0.00% | 65.308ms +0.61% | ±0.50% -10.85% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev         |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 95.641mb +0.00%  | 464.172ms +1.38% | ±0.89% +48.09% |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.114mb +0.00%  | 72.703ms +0.74%  | ±0.43% +41.99% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 106.545mb +0.00% | 54.161ms +3.13%  | ±1.84% -42.06% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 321.755mb +0.00% | 1.533s +2.31%    | ±0.64% -34.99% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.939mb +0.00%  | 41.380ms +0.60%  | ±0.22% -64.81% |
+--------------------+----------------+------+-----+------------------+------------------+----------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.675mb +0.00%  | 4.034ms +7.55%   | ±1.54% -40.27%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.402mb +0.00%  | 185.960ms +3.22% | ±1.51% +77.48%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.928mb +0.00%  | 18.615ms +1.68%  | ±0.75% -55.82%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.915mb +0.00%  | 1.921ms +0.68%   | ±1.10% -54.08%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.915mb +0.00%  | 1.821ms -8.65%   | ±0.83% -33.23%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 75.027mb +0.00%  | 2.908ms +10.61%  | ±1.27% -59.70%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.556mb +0.00%  | 15.476ms +4.11%  | ±1.68% +137.61% |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.556mb +0.00%  | 15.035ms +1.11%  | ±0.52% -69.83%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.460mb +0.00%  | 1.994μs +11.15%  | ±2.40% -10.17%  |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.460mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 87.015mb +0.00%  | 13.746ms +2.16%  | ±1.15% -27.80%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.375mb +0.00% | 64.343ms -0.80%  | ±0.97% -18.84%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 76.076mb +0.00%  | 1.454ms -3.18%   | ±2.46% +88.65%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.423mb +0.00%  | 60.704ms +6.05%  | ±1.04% +664.72% |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 78.177mb +0.00%  | 4.025ms -2.70%   | ±1.01% -46.57%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.538mb +0.00%  | 40.796ms +0.12%  | ±1.15% +29.19%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.539mb +0.00%  | 41.475ms +1.40%  | ±3.51% +343.36% |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.538mb +0.00%  | 42.983ms +5.88%  | ±2.30% +89.55%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.901mb +0.00%  | 7.613ms +2.17%   | ±0.68% -44.27%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.460mb +0.00%  | 29.248ms +0.68%  | ±1.34% +24.63%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.460mb +0.00%  | 13.738μs -1.16%  | ±2.69% +6.64%   |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.460mb +0.00%  | 16.500μs +2.75%  | ±0.49% -72.77%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.403mb +0.00%  | 190.291ms +1.91% | ±0.83% +35.03%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.707mb +0.00% | 501.906ms +0.69% | ±2.20% +256.35% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 60.185mb +0.00%  | 247.005ms -0.71% | ±0.15% -78.03%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 15.118mb +0.00%  | 53.451ms -0.08%  | ±1.36% +63.28%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.958mb +0.00%  | 434.067ms -0.37% | ±0.21% -81.03%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.497mb +0.00%  | 87.476ms +0.87%  | ±0.69% -2.48%   |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech deleted the parquet/library branch December 5, 2024 20:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant