Skip to content

Develop Process - same functionality as USIDataset #12

Open
@ssomnath

Description

  1. What changes would you like to make to this class if you could - this is your chance.
  2. __init__ can't be taken more or less as is -
    • would need some way to figure out how to flatten the data into two axes - examples vs features (over which data would be processed)
  3. Take these functions as is:
    • assign job indices
    • estimate compute time per pixel
    • get pixels in current batch
    • test
    • use_partial_Computation
    • set_cores
    • set_memory_and_cores
    • map_function
    • write_results_chunk
    • create_results_dataset
    • write_source_dset_provenance
    • get_existing_datasets
    • _unit_computation
  4. Rewrite the following:
    • check for duplicates
    • set_memory
    • read_data_chunk
    • create_compute_status_dataset
  5. Carefully rewrite compute()

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Labels

corecore classes or infrastructureenhancementNew feature or request

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions