Added file analyze command to CLI

[norberttech]

Change Log

Added

• Added file analyze command to CLI

Fixed

Changed

Removed

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak        | mode             | rstdev          |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.786mb +0.02%  | 554.217ms -1.01% | ±0.65% +55.31%  |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.860mb +0.02%  | 1.086s +0.22%    | ±1.82% -24.94%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 86.300mb +0.00% | 916.211ms -0.18% | ±0.32% +65.74%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.517mb +0.02%  | 35.629ms -0.60%  | ±0.99% +37.09%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.491mb +0.02%  | 612.193ms +0.71% | ±0.69% +142.84% |
+-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 127.313mb +0.00% | 72.521ms -4.61% | ±0.58% -56.77% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 63.984mb +0.00%  | 106.451ms -0.61% | ±0.98% -18.50%  |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 84.331mb +0.00%  | 102.592ms +2.52% | ±0.13% -79.10%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 161.172mb +0.00% | 21.245s -1.47%   | ±1.05% +118.32% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.983mb +0.00%  | 31.968ms +0.08%  | ±0.67% -14.58%  |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+

Building Blocks

+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark         | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 105.956mb +0.00% | 466.983ms -0.72% | ±1.44% +10.45%  |
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 55.146mb +0.00%  | 232.304ms -2.06% | ±0.06% -96.46%  |
| EntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.668mb +0.01%  | 50.698ms -4.65%  | ±1.97% +16.80%  |
| RowsBench         | bench_chunk_10_on_10k      | 2    | 3   | 96.999mb +0.00%  | 4.217ms -0.82%   | ±2.95% +106.94% |
| RowsBench         | bench_diff_left_1k_on_10k  | 2    | 3   | 114.281mb +0.00% | 185.995ms -1.31% | ±0.48% -32.84%  |
| RowsBench         | bench_diff_right_1k_on_10k | 2    | 3   | 97.001mb +0.00%  | 19.076ms -2.05%  | ±0.48% -51.63%  |
| RowsBench         | bench_drop_1k_on_10k       | 2    | 3   | 97.874mb +0.00%  | 2.113ms -7.44%   | ±2.79% +47.44%  |
| RowsBench         | bench_drop_right_1k_on_10k | 2    | 3   | 97.874mb +0.00%  | 2.176ms +8.37%   | ±1.24% -29.89%  |
| RowsBench         | bench_entries_on_10k       | 2    | 3   | 96.035mb +0.00%  | 6.128ms +9.55%   | ±2.90% -2.36%   |
| RowsBench         | bench_filter_on_10k        | 2    | 3   | 96.564mb +0.00%  | 17.285ms -3.16%  | ±1.12% -43.60%  |
| RowsBench         | bench_find_on_10k          | 2    | 3   | 96.564mb +0.00%  | 17.391ms -3.23%  | ±0.60% -73.22%  |
| RowsBench         | bench_find_one_on_10k      | 10   | 3   | 95.255mb +0.00%  | 2.000μs -0.30%   | ±0.00% -100.00% |
| RowsBench         | bench_first_on_10k         | 10   | 3   | 95.255mb +0.00%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench         | bench_flat_map_on_1k       | 2    | 3   | 104.473mb +0.00% | 17.056ms -4.64%  | ±0.58% +56.98%  |
| RowsBench         | bench_map_on_10k           | 2    | 3   | 134.540mb +0.00% | 75.962ms -2.39%  | ±0.67% -24.22%  |
| RowsBench         | bench_merge_1k_on_10k      | 2    | 3   | 97.083mb +0.00%  | 2.152ms +9.44%   | ±2.39% +110.69% |
| RowsBench         | bench_partition_by_on_10k  | 2    | 3   | 100.381mb +0.00% | 65.689ms -2.75%  | ±1.23% +33.44%  |
| RowsBench         | bench_remove_on_10k        | 2    | 3   | 98.136mb +0.00%  | 4.663ms +1.91%   | ±1.57% +259.43% |
| RowsBench         | bench_sort_asc_on_1k       | 2    | 3   | 95.543mb +0.00%  | 44.215ms -3.63%  | ±1.81% +50.66%  |
| RowsBench         | bench_sort_by_on_1k        | 2    | 3   | 95.543mb +0.00%  | 44.412ms -0.86%  | ±2.91% +292.97% |
| RowsBench         | bench_sort_desc_on_1k      | 2    | 3   | 95.543mb +0.00%  | 44.547ms -2.33%  | ±0.31% -91.44%  |
| RowsBench         | bench_sort_entries_on_1k   | 2    | 3   | 97.695mb +0.00%  | 9.446ms +2.80%   | ±2.65% +151.89% |
| RowsBench         | bench_sort_on_1k           | 2    | 3   | 95.445mb +0.00%  | 31.515ms -2.84%  | ±3.34% +91.32%  |
| RowsBench         | bench_take_1k_on_10k       | 10   | 3   | 95.255mb +0.00%  | 14.700μs -10.01% | ±0.56% -78.08%  |
| RowsBench         | bench_take_right_1k_on_10k | 10   | 3   | 95.255mb +0.00%  | 16.599μs -13.19% | ±1.48% +125.58% |
| RowsBench         | bench_unique_on_1k         | 2    | 3   | 114.282mb +0.00% | 189.583ms +0.22% | ±0.57% -31.87%  |
| TypeDetectorBench | bench_type_detector        | 1    | 3   | 43.791mb +0.00%  | 366.781ms +0.85% | ±1.03% +296.82% |
| TypeDetectorBench | bench_type_detector        | 1    | 3   | 11.601mb +0.01%  | 73.025ms -1.19%  | ±1.21% +96.53%  |
+-------------------+----------------------------+------+-----+------------------+------------------+-----------------+

[codecov]

Codecov Report

Attention: Patch coverage is 95.60440% with 4 lines in your changes missing coverage. Please review.

Project coverage is 83.00%. Comparing base (5d07c2b) to head (981ab10).
Report is 2 commits behind head on 1.x.

Additional details and impacted files

@@            Coverage Diff             @@
##              1.x    #1438      +/-   ##
==========================================
+ Coverage   82.93%   83.00%   +0.06%     
==========================================
  Files         657      659       +2     
  Lines       17632    17721      +89     
==========================================
+ Hits        14623    14709      +86     
- Misses       3009     3012       +3     

Components	Coverage Δ
etl	85.75% <100.00%> (ø)
cli	86.73% <95.50%> (+1.56%)	⬆️
lib-array-dot	94.53% <ø> (ø)
lib-azure-sdk	62.56% <ø> (ø)
lib-doctrine-dbal-bulk	97.36% <ø> (ø)
lib-filesystem	76.75% <ø> (ø)
lib-parquet	84.33% <ø> (ø)
lib-parquet-viewer	82.02% <ø> (ø)
lib-rdsl	87.09% <ø> (ø)
lib-snappy	91.16% <ø> (+0.46%)	⬆️
bridge-filesystem-async-aws	90.38% <ø> (ø)
bridge-filesystem-azure	89.92% <ø> (ø)
bridge-monolog-http	96.38% <ø> (ø)
symfony-http-foundation	77.10% <ø> (ø)
adapter-chartjs	86.45% <ø> (ø)
adapter-csv	89.49% <ø> (ø)
adapter-doctrine	88.54% <ø> (ø)
adapter-elasticsearch	97.19% <ø> (ø)
adapter-google-sheet	78.04% <ø> (ø)
adapter-http	59.15% <ø> (ø)
adapter-json	92.85% <ø> (ø)
adapter-logger	53.84% <ø> (ø)
adapter-meilisearch	97.75% <ø> (ø)
adapter-parquet	80.85% <ø> (ø)
adapter-text	84.44% <ø> (ø)
adapter-xml	83.15% <ø> (ø)