mdvtools.csv_to_static#

Attributes#

Functions#

rename_columns()

get_column_type(name)

get_quantiles(col)

get_text_indices(col)

get_column_groups()

get_datasource()

Has some side effects on the dataframe:

replace_text_values(col, values)

get_views()

get_state()

convert_data_to_binary(df)

Converts the dataframe to binary format.

main()

Module Contents#

mdvtools.csv_to_static.parser[source]#
mdvtools.csv_to_static.parse_multitext = True[source]#
mdvtools.csv_to_static.args[source]#
mdvtools.csv_to_static.separator[source]#
mdvtools.csv_to_static.filename[source]#
mdvtools.csv_to_static.filename[source]#
mdvtools.csv_to_static.basename[source]#
mdvtools.csv_to_static.outdir[source]#
mdvtools.csv_to_static.outdir[source]#
mdvtools.csv_to_static.indir[source]#
mdvtools.csv_to_static.has_images = False[source]#
mdvtools.csv_to_static.df[source]#
mdvtools.csv_to_static.types[source]#
mdvtools.csv_to_static.col_types[source]#
mdvtools.csv_to_static.rename_columns()[source]#
mdvtools.csv_to_static.get_column_type(name)[source]#
mdvtools.csv_to_static.get_quantiles(col)[source]#
mdvtools.csv_to_static.get_text_indices(col)[source]#
mdvtools.csv_to_static.get_column_groups()[source]#
mdvtools.csv_to_static.get_datasource()[source]#

Has some side effects on the dataframe: if args.discard_redundant:

  • removes columns that are redundant (all the same value)

text columns are converted to indices.

Outputs a descriptor like this: {

“name”: “metric_table”, “size”: number of rows, “images”: {

“images”: {

“base_url”: “./images/”, “type”: “png”, “key_column”: “image_id”

}

} “columns”: [

{

“datatype”: “float” | “integer” | “text” | “unique”, “name”: “column_name”, “field”: “column_name”, “minMax”?: [min, max], “quantiles”?: …, “values”?: [‘a’, ‘b’, ‘c’],

}

]

}

mdvtools.csv_to_static.replace_text_values(col, values)[source]#
mdvtools.csv_to_static.get_views()[source]#
mdvtools.csv_to_static.get_state()[source]#
mdvtools.csv_to_static.convert_data_to_binary(df)[source]#

Converts the dataframe to binary format.

mdvtools.csv_to_static.main()[source]#