0

Any way to reverse engineer from S3 Datalakes

Arup Nanda

October 22, 2019 14:32

None

Follow

Is there any way to get a model reverse engineered from a S3 data lake? Files are stored in Parquet format.

• Facebook
• Twitter
• LinkedIn

3 comments

• 
  Helpdesk October 22, 2019 14:39 Official comment

  Yes, this feature is already designed, and scheduled for development later this year in a new Parquet plugin.  S3 is definitely a source from which reverse-engineering would take place (in addition to local file system and maybe Azure Blob storage.)

• 0
  
  Arup Nanda October 22, 2019 16:22

  Thank you. In the meantime (before the official release), do you have a cookbook to do the reverse engineering from S3 using some other means?

   

• 0
  
  Helpdesk October 22, 2019 16:29

  I'm afraid that most of the development is related to reverse-engineering of Parquet.  The fact that the Parquet file are on S3 rather than on a local file system is not a very hard or big part of the development.  And unfortunately, until such development is done, there's not much I can provide.  Please send us your email to info@hackolade.com, and we'll make sure to notify you as soon as the plugin is ready.