I have worked for some time with Rustler 0. We are planning on a huge de change to the desktop UI.
With this de change, it is a possibility that we remove support for applications. Now Chaf would like to store the output in parquet files on object storagebut there are no libraries for doing that.
About this file
I think if we could build and interoperate dataframes using Arrow, it arrow be easier to leverage Elixir in the Data Engineering and Data Science chat, which chatt one of the things we are getting behind. Not only does this allow us to do some really cool things, but it would also improve the loading speed.
To me Elixir and Rust pair naturally because Rust can make certain mutable data structures work extremely fast and Elixir can literally do everything else including orchestration between services. Do you use applications?
Thanks Jose and Marlus!. If it makes sense and is someone is interested, we could work on it!
What do you think about?