Allow to append into parquet files

[norberttech]

Change Log

Added

• Allow to append into parquet files

Fixed

Changed

Removed

Deprecated

Security

---

Description

Closes: #685

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+-------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode              | rstdev          |
+-----------------------+-------------------+------+-----+------------------+-------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 44.091mb +0.00%  | 469.879ms +8.11%  | ±3.19% +876.94% |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 13.976mb +0.00%  | 360.098ms +5.53%  | ±1.89% +476.13% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 18.638mb +0.00%  | 717.775ms +8.64%  | ±1.23% +786.33% |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 242.972mb +0.00% | 1.024s +10.21%    | ±1.00% +117.23% |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 7.246mb +0.00%   | 21.028ms +10.89%  | ±1.82% +373.26% |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 7.593mb +0.00%   | 694.540ms +21.42% | ±2.28% +767.51% |
+-----------------------+-------------------+------+-----+------------------+-------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+-----------------+------------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak        | mode             | rstdev         |
+-----------------------------+--------------------------+------+-----+-----------------+------------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 87.032mb +0.00% | 76.856ms +19.52% | ±0.84% +29.36% |
+-----------------------------+--------------------------+------+-----+-----------------+------------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+-------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode              | rstdev          |
+--------------------+----------------+------+-----+------------------+-------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 93.195mb +0.00%  | 760.186ms +12.84% | ±0.50% -22.18%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 47.109mb +0.00%  | 73.353ms +2.21%   | ±2.49% +709.24% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 88.543mb +0.00%  | 77.895ms +11.45%  | ±1.69% -48.33%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 286.871mb +0.00% | 1.653s +13.76%    | ±0.87% +353.73% |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 16.531mb +0.00%  | 38.248ms +6.58%   | ±2.43% +106.46% |
+--------------------+----------------+------+-----+------------------+-------------------+-----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+-----------------+-------------------+------------------+
| benchmark               | subject                    | revs | its | mem_peak        | mode              | rstdev           |
+-------------------------+----------------------------+------+-----+-----------------+-------------------+------------------+
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 60.656mb +0.00% | 4.030ms +9.50%    | ±2.10% +39.63%   |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 80.448mb +0.00% | 189.877ms +7.37%  | ±2.05% +8342.65% |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 58.974mb +0.00% | 18.803ms +3.13%   | ±3.03% +406.03%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 59.795mb +0.00% | 3.057ms -0.29%    | ±2.61% +2.99%    |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 59.795mb +0.00% | 3.394ms +6.18%    | ±1.45% -56.49%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 59.008mb +0.00% | 4.204ms +9.97%    | ±3.26% +359.79%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 59.537mb +0.00% | 23.991ms +34.01%  | ±1.16% +69.07%   |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 59.536mb +0.00% | 24.166ms +35.13%  | ±2.04% +665.76%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 57.608mb +0.00% | 2.206μs -11.54%   | ±2.11% +10.45%   |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 57.608mb +0.00% | 0.500μs 0.00%     | ±0.00% 0.00%     |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 65.841mb +0.00% | 14.451ms +5.29%   | ±3.03% +139.35%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 91.361mb +0.00% | 66.124ms +13.83%  | ±3.45% +190.93%  |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 60.057mb +0.00% | 3.341ms +8.55%    | ±2.89% +22.99%   |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 62.327mb +0.00% | 50.967ms +24.93%  | ±3.02% +237.36%  |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 62.158mb +0.00% | 8.427ms +22.75%   | ±3.16% +1.24%    |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 57.608mb +0.00% | 53.580ms +16.34%  | ±2.84% +1272.91% |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 57.608mb +0.00% | 53.671ms +16.33%  | ±1.70% +212.21%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 57.608mb +0.00% | 52.892ms +13.07%  | ±2.62% +841.11%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 59.882mb +0.00% | 9.747ms -2.66%    | ±0.66% -65.48%   |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 57.607mb +0.00% | 39.408ms +9.24%   | ±0.83% +75.81%   |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 57.608mb +0.00% | 22.517μs +8.78%   | ±2.19% +178.18%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 57.608mb +0.00% | 29.695μs +11.22%  | ±2.52% +0.00%    |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 80.449mb +0.00% | 211.913ms +17.29% | ±3.11% +622.75%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 91.715mb +0.02% | 164.192ms +13.90% | ±1.01% +2253.35% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 47.599mb -0.00% | 83.089ms +13.96%  | ±1.52% +1173.40% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 12.389mb -0.04% | 19.954ms +13.94%  | ±1.02% +156.73%  |
+-------------------------+----------------------------+------+-----+-----------------+-------------------+------------------+