Flow filesystem introduction

[norberttech]

Change Log

Added

• Flow Filesystem Library
• Flow Azure SDK Library
• Flow Monolog HTTP Bridge
• Flow Filesystem Azure Bridge

Fixed

Changed

• Remote and Local files extractor are now merged into single FilesExtractor

Removed

• Parquet append to existing files

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+-------------------+----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode              | rstdev         |
+-----------------------+-------------------+------+-----+------------------+-------------------+----------------+
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 5.175mb -24.44%  | 506.404ms +50.73% | ±0.19% +34.73% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 5.208mb -24.29%  | 1.060s -0.71%     | ±0.77% -65.98% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 135.881mb -0.37% | 738.818ms -1.98%  | ±0.15% -91.04% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.965mb -26.09%  | 34.019ms -5.17%   | ±0.89% +39.21% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.971mb -27.25%  | 432.851ms -0.11%  | ±0.26% -59.21% |
+-----------------------+-------------------+------+-----+------------------+-------------------+----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 116.272mb -0.27% | 57.839ms -2.77% | ±0.17% -87.20% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 55.254mb -2.15%  | 86.471ms +27.39% | ±1.60% +404.99% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 107.628mb -1.05% | 53.281ms +3.77%  | ±1.41% +127.22% |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 227.051mb -0.54% | 1.406s -0.02%    | ±0.98% +294.86% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 18.009mb -6.39%  | 43.133ms +10.95% | ±1.36% +398.74% |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 116.821mb -0.26% | 501.117ms -1.26% | ±1.49% -40.10%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 60.299mb -0.51%  | 249.807ms -0.88% | ±0.25% -79.19%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 15.233mb -2.02%  | 54.932ms +1.21%  | ±1.98% +8.33%   |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 60.000mb -0.51%  | 435.420ms +0.75% | ±3.03% +350.09% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.539mb -2.12%  | 85.049ms -2.00%  | ±0.74% +98.56%  |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 87.091mb -0.35%  | 3.381ms -6.52%   | ±1.44% -51.19%  |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 102.689mb -0.30% | 187.121ms -0.07% | ±0.64% -20.44%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 85.409mb -0.36%  | 18.822ms -0.68%  | ±0.63% -39.48%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 88.331mb -0.35%  | 1.786ms -5.57%   | ±2.55% -5.78%   |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 88.331mb -0.35%  | 1.727ms -13.67%  | ±0.85% -63.78%  |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 85.443mb -0.36%  | 2.571ms -16.14%  | ±0.98% -62.04%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 85.972mb -0.36%  | 17.518ms +6.96%  | ±0.64% -59.18%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 85.972mb -0.36%  | 16.991ms -0.87%  | ±0.82% -30.37%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 83.876mb -0.37%  | 1.606μs -10.47%  | ±2.89% +8.16%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 83.876mb -0.37%  | 0.300μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 93.226mb -0.33%  | 13.109ms +6.36%  | ±3.14% +468.00% |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 122.597mb -0.25% | 60.561ms -1.89%  | ±1.52% +190.57% |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 86.492mb -0.36%  | 1.297ms -17.92%  | ±2.96% -14.30%  |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 89.838mb -0.34%  | 62.800ms -2.90%  | ±0.88% +5.64%   |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 88.593mb -0.35%  | 4.108ms -6.43%   | ±1.11% -40.97%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 84.019mb -0.44%  | 38.874ms -2.94%  | ±1.06% +29.01%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 84.020mb -0.44%  | 39.467ms -2.13%  | ±0.37% -30.17%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 84.019mb -0.44%  | 39.557ms -1.29%  | ±1.07% -63.22%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 86.317mb -0.36%  | 7.324ms -1.08%   | ±0.77% +23.32%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 83.876mb -0.37%  | 28.362ms -2.33%  | ±0.21% -84.02%  |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 83.876mb -0.37%  | 13.900μs +2.25%  | ±0.00% -100.00% |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 83.876mb -0.37%  | 16.483μs +0.43%  | ±1.30% +127.29% |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 102.690mb -0.30% | 189.816ms -1.39% | ±0.42% -76.47%  |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+