-
-
Notifications
You must be signed in to change notification settings - Fork 48
Added composer.json to each example and make it standalone downloadable project #1440
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added composer.json to each example and make it standalone downloadable project #1440
Conversation
Flow PHP - BenchmarksResults of the benchmarks from this PR are compared with the results from 1.x branch. Extractors+-----------------------+-------------------+------+-----+-----------------+------------------+------------------+
| benchmark | subject | revs | its | mem_peak | mode | rstdev |
+-----------------------+-------------------+------+-----+-----------------+------------------+------------------+
| CSVExtractorBench | bench_extract_10k | 1 | 3 | 4.787mb +0.11% | 524.267ms -5.46% | ±2.01% +484.44% |
| JsonExtractorBench | bench_extract_10k | 1 | 3 | 4.860mb +0.11% | 1.020s -3.72% | ±0.90% -25.62% |
| ParquetExtractorBench | bench_extract_10k | 1 | 3 | 86.301mb +0.01% | 853.720ms -4.52% | ±2.70% +2478.50% |
| TextExtractorBench | bench_extract_10k | 1 | 3 | 4.517mb +0.12% | 35.921ms +1.26% | ±2.08% +434.54% |
| XmlExtractorBench | bench_extract_10k | 1 | 3 | 4.492mb +0.12% | 588.918ms -2.27% | ±0.84% +113.79% |
+-----------------------+-------------------+------+-----+-----------------+------------------+------------------+
Transformers+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| benchmark | subject | revs | its | mem_peak | mode | rstdev |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1 | 3 | 127.314mb +0.00% | 69.267ms -1.85% | ±1.85% +630.23% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+
Loaders+--------------------+----------------+------+-----+------------------+-----------------+-----------------+
| benchmark | subject | revs | its | mem_peak | mode | rstdev |
+--------------------+----------------+------+-----+------------------+-----------------+-----------------+
| CSVLoaderBench | bench_load_10k | 1 | 3 | 63.985mb +0.01% | 99.234ms -4.07% | ±2.40% +15.73% |
| JsonLoaderBench | bench_load_10k | 1 | 3 | 84.332mb +0.01% | 92.502ms -7.53% | ±1.05% +329.48% |
| ParquetLoaderBench | bench_load_10k | 1 | 3 | 161.172mb +0.00% | 19.692s -4.00% | ±0.35% +109.27% |
| TextLoaderBench | bench_load_10k | 1 | 3 | 17.983mb +0.03% | 28.990ms -8.03% | ±2.82% +888.13% |
+--------------------+----------------+------+-----+------------------+-----------------+-----------------+
Building Blocks+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark | subject | revs | its | mem_peak | mode | rstdev |
+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| EntryFactoryBench | bench_entry_factory | 1 | 3 | 105.956mb +0.01% | 450.652ms +0.13% | ±3.25% +194.71% |
| EntryFactoryBench | bench_entry_factory | 1 | 3 | 55.147mb +0.01% | 220.302ms -4.82% | ±1.08% +379.38% |
| EntryFactoryBench | bench_entry_factory | 1 | 3 | 14.669mb +0.04% | 48.413ms -1.95% | ±1.78% +197.42% |
| RowsBench | bench_chunk_10_on_10k | 2 | 3 | 97.000mb +0.01% | 3.155ms -2.83% | ±1.75% -31.65% |
| RowsBench | bench_diff_left_1k_on_10k | 2 | 3 | 114.282mb +0.00% | 182.742ms +1.63% | ±1.81% +172.45% |
| RowsBench | bench_diff_right_1k_on_10k | 2 | 3 | 97.002mb +0.01% | 18.528ms +0.83% | ±2.95% +342.92% |
| RowsBench | bench_drop_1k_on_10k | 2 | 3 | 97.875mb +0.01% | 1.341ms -12.62% | ±1.51% -41.11% |
| RowsBench | bench_drop_right_1k_on_10k | 2 | 3 | 97.875mb +0.01% | 1.365ms -10.83% | ±3.11% +703.13% |
| RowsBench | bench_entries_on_10k | 2 | 3 | 96.035mb +0.01% | 4.092ms -4.36% | ±0.79% -54.13% |
| RowsBench | bench_filter_on_10k | 2 | 3 | 96.564mb +0.01% | 15.921ms -2.14% | ±0.66% +1.49% |
| RowsBench | bench_find_on_10k | 2 | 3 | 96.564mb +0.01% | 16.158ms -0.70% | ±3.05% +58.91% |
| RowsBench | bench_find_one_on_10k | 10 | 3 | 95.256mb +0.01% | 1.794μs -10.30% | ±2.67% +0.00% |
| RowsBench | bench_first_on_10k | 10 | 3 | 95.256mb +0.01% | 0.300μs 0.00% | ±0.00% 0.00% |
| RowsBench | bench_flat_map_on_1k | 2 | 3 | 104.474mb +0.01% | 14.347ms -0.90% | ±1.02% +19.02% |
| RowsBench | bench_map_on_10k | 2 | 3 | 134.541mb +0.00% | 67.889ms -4.80% | ±1.43% +624.76% |
| RowsBench | bench_merge_1k_on_10k | 2 | 3 | 97.084mb +0.01% | 1.248ms -5.54% | ±0.87% -77.49% |
| RowsBench | bench_partition_by_on_10k | 2 | 3 | 100.381mb +0.01% | 62.513ms -1.90% | ±1.01% +296.20% |
| RowsBench | bench_remove_on_10k | 2 | 3 | 98.137mb +0.01% | 3.544ms -8.15% | ±3.26% +31.74% |
| RowsBench | bench_sort_asc_on_1k | 2 | 3 | 95.544mb +0.01% | 41.743ms +0.84% | ±2.52% +174.35% |
| RowsBench | bench_sort_by_on_1k | 2 | 3 | 95.544mb +0.01% | 40.718ms -0.77% | ±1.49% +356.11% |
| RowsBench | bench_sort_desc_on_1k | 2 | 3 | 95.544mb +0.01% | 42.006ms +2.55% | ±1.06% -4.01% |
| RowsBench | bench_sort_entries_on_1k | 2 | 3 | 97.696mb +0.01% | 8.289ms -0.37% | ±2.73% +241.34% |
| RowsBench | bench_sort_on_1k | 2 | 3 | 95.446mb +0.01% | 28.611ms -3.15% | ±1.58% +7.00% |
| RowsBench | bench_take_1k_on_10k | 10 | 3 | 95.256mb +0.01% | 12.812μs -3.23% | ±0.73% -66.35% |
| RowsBench | bench_take_right_1k_on_10k | 10 | 3 | 95.256mb +0.01% | 15.259μs +1.30% | ±1.62% -35.77% |
| RowsBench | bench_unique_on_1k | 2 | 3 | 114.283mb +0.00% | 188.448ms +2.15% | ±1.85% +177.23% |
| TypeDetectorBench | bench_type_detector | 1 | 3 | 43.792mb +0.01% | 357.448ms -1.29% | ±1.06% +40.48% |
| TypeDetectorBench | bench_type_detector | 1 | 3 | 11.602mb +0.05% | 72.399ms -0.12% | ±0.50% +89.20% |
+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## 1.x #1440 +/- ##
==========================================
- Coverage 83.00% 82.99% -0.02%
==========================================
Files 659 659
Lines 17721 17721
==========================================
- Hits 14710 14708 -2
- Misses 3011 3013 +2
|
.github/workflows/test-suite.yml
Outdated
| run: "composer test:adapter:xml" | ||
|
|
||
| - name: "Test - Examples" | ||
| if: ${{ matrix.php-version == '8.2' && matrix.dependencies == 'locked' }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
After releasing 0.11.0 this can be removed. Some examples are failing because if all dependencies are not explicitly provided like array-dot which a dependency of etl composer will not install dependencies due to array-dot php version constraint in release 0.10.0
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(fixed indention)
Change Log
Added
Fixed
Changed
Removed
Deprecated
Security
Description