Skip to content

Large public data set and modeling inference ingestion #4

Closed

Description

@kordless

Various large public data sets exist on Kaggle, etc. which may be used with ML pipelines.

  • determine which data sets would produce large numbers of entries
  • add logging to pipelines to log the data to FeatureBase
  • use a visualizer example with the data and include queries that can be run to produce graphs

Activity

  1. self-assigned this
    on Oct 14, 2022
  2. kordless commented on Nov 7, 2022

    @kordless
    ContributorAuthor

    This is inbound in the /set directory. Insertion was tested to 24M entries.

  3. kordless commented on Nov 7, 2022

    @kordless
    ContributorAuthor

    Will be renaming "set" directories to "bigdata-set".

  4. changed the title [-]Large public data set ingestion[/-] [+]Large public data set and modeling inference ingestion[/+] on Nov 11, 2022
  5. kordless commented on Nov 11, 2022

    @kordless
    ContributorAuthor

    Replaced by #15

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions