Skip to content

Conversation

@norberttech
Copy link
Member

Change Log

Added

  • DataFrame::schema method to just read schema from dataset

Fixed

Changed

Removed

Deprecated

Security


Description

@github-actions
Copy link
Contributor

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev         |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.134mb -0.00%  | 709.338ms -0.89% | ±0.15% -93.64% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.828mb +0.03%   | 328.016ms +0.51% | ±0.30% +17.24% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.892mb +0.03%   | 938.364ms -0.68% | ±0.74% -64.41% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.597mb +0.00% | 1.147s +0.01%    | ±0.56% +90.35% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.663mb +0.03%   | 32.130ms +1.04%  | ±0.61% +27.84% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.664mb +0.03%   | 430.406ms -1.28% | ±0.74% +29.33% |
+-----------------------+-------------------+------+-----+------------------+------------------+----------------+
Transformers
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.377mb +0.00% | 64.483ms +0.40% | ±0.88% -17.73% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
Loaders
+--------------------+----------------+------+-----+------------------+------------------+------------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev           |
+--------------------+----------------+------+-----+------------------+------------------+------------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.754mb +0.00%  | 462.488ms +1.72% | ±0.42% -29.43%   |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.862mb +0.00%  | 71.851ms +0.34%  | ±0.75% +19.80%   |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.348mb +0.00% | 55.096ms -1.95%  | ±1.72% -17.64%   |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.559mb +0.00% | 1.257s -1.91%    | ±1.02% +1315.42% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.719mb +0.01%  | 41.080ms +0.69%  | ±0.77% -48.09%   |
+--------------------+----------------+------+-----+------------------+------------------+------------------+
Building Blocks
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.006mb +0.00% | 395.748ms -0.26% | ±1.18% +177.15% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.724mb +0.00%  | 194.860ms -2.23% | ±1.21% +67.26%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.850mb +0.01%  | 42.128ms -3.82%  | ±1.62% -1.18%   |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.403mb +0.00%  | 332.556ms +0.56% | ±0.46% -65.39%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.326mb +0.01%  | 65.249ms -0.99%  | ±0.45% -71.67%  |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.457mb +0.00%  | 3.304ms -3.19%   | ±0.87% -66.51%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.250mb +0.00%  | 181.030ms +1.31% | ±0.39% -7.38%   |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.775mb +0.00%  | 18.017ms +0.63%  | ±0.16% -88.70%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.697mb +0.00%  | 1.681ms +0.85%   | ±0.29% -86.81%  |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.697mb +0.00%  | 1.734ms +5.60%   | ±2.54% +9.99%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.809mb +0.00%  | 2.536ms -0.85%   | ±0.93% -72.37%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.338mb +0.00%  | 14.638ms +2.47%  | ±0.69% -35.81%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.338mb +0.00%  | 14.330ms +0.84%  | ±1.04% -41.16%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.241mb +0.00%  | 1.894μs +5.57%   | ±2.53% -5.36%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.241mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.797mb +0.00%  | 12.471ms -0.22%  | ±1.09% +98.18%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.157mb +0.00% | 63.601ms +0.51%  | ±1.47% +408.31% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.858mb +0.00%  | 1.271ms +7.61%   | ±2.49% +96.36%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.205mb +0.00%  | 57.315ms +0.73%  | ±0.54% -35.19%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.959mb +0.00%  | 3.857ms +1.29%   | ±0.97% +88.60%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.386mb +0.00%  | 39.966ms -1.78%  | ±1.87% +236.84% |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.387mb +0.00%  | 39.921ms -0.67%  | ±2.49% +802.29% |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.386mb +0.00%  | 40.569ms +2.50%  | ±0.27% -76.65%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.683mb +0.00%  | 7.384ms +0.57%   | ±0.31% -49.78%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.241mb +0.00%  | 29.812ms +1.56%  | ±3.64% +303.88% |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.241mb +0.00%  | 13.600μs +2.31%  | ±1.20% +237.92% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.241mb +0.00%  | 16.844μs +6.57%  | ±2.20% +637.55% |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.251mb +0.00%  | 183.084ms -2.56% | ±0.75% -35.33%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+

@norberttech norberttech merged commit 2253b91 into flow-php:1.x Jan 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant