mvn.aux_pandas package

Submodules

mvn.aux_pandas.aux_pandas module

mvn.aux_pandas.aux_pandas.fix_column_names(df0, lowercase=False)[source]
mvn.aux_pandas.aux_pandas.disp_df(df0, **opt)[source]

Display DF using custom formatting context.

Examples

>>> import numpy as np
>>> import pandas as pd
>>> from mvn import disp_df
>>> from mvn.aux_pandas import wine_df
>>> disp_df(df0)
mvn.aux_pandas.aux_pandas.repr_df(df0, **opt)[source]

Get DF repr using custom formatting context.

Examples

>>> import numpy as np
>>> import pandas as pd
>>> from mvn import disp_df
>>> from mvn.aux_pandas import wine_df
>>> print(repr_df(df0))
mvn.aux_pandas.aux_pandas.split_dataframe(dframe, max_rows)[source]

Split pandas dataframe into chunks with max_rows.

Examples

>>> import pathlib.Path
>>> from mvn.aux_pandas import split_dataframe
>>> df0 = pd.DataFrame({'A': range(1, 21), 'B': range(21, 41)})
>>> max_rows = 5e0 # 25e4
>>> chunks_dict = split_dataframe(df0, max_rows)
>>>
>>> dir0 = "../../data/i0000-data-chunks/"
>>> dir0 = pathlib.Path(dir0)
>>> dir0.mkdir(mode=0o700, parents=True, exist_ok=True)
>>>
>>> for key, chunk in chunks_dict.items():
>>>     print(f"{key}: {chunk.shape}")
>>>     # print(chunk)
>>>     chunk.to_pickle((dir0/key).with_suffix(".pkl"))
>>>     print("")

Module contents