|
12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394 |
- Recommendation Model
- ## Overview
- This is an implementation of WideDeep as described in the [Wide & Deep Learning for Recommender System](https://arxiv.org/pdf/1606.07792.pdf) paper.
-
- WideDeep model jointly trained wide linear models and deep neural network, which combined the benefits of memorization and generalization for recommender systems.
-
- ## Dataset
- The Criteo datasets are used for model training and evaluation.
-
- ## Running Code
-
- ### Code Structure
- The entire code structure is as following:
- ```
- |--- wide_and_deep/
- train_and_test.py "Entrance of Wide&Deep model training and evaluation"
- test.py "Entrance of Wide&Deep model evaluation"
- train.py "Entrance of Wide&Deep model training"
- train_and_test_multinpu.py "Entrance of Wide&Deep model data parallel training and evaluation"
- |--- src/ "entrance of training and evaluation"
- config.py "parameters configuration"
- dataset.py "Dataset loader class"
- process_data.py "process dataset"
- preprocess_data.py "pre_process dataset"
- WideDeep.py "Model structure"
- callbacks.py "Callback class for training and evaluation"
- metrics.py "Metric class"
- ```
-
- ### Train and evaluate model
- To train and evaluate the model, command as follows:
- ```
- python train_and_test.py
- ```
- Arguments:
- * `--data_path`: This should be set to the same directory given to the data_download's data_dir argument.
- * `--epochs`: Total train epochs.
- * `--batch_size`: Training batch size.
- * `--eval_batch_size`: Eval batch size.
- * `--field_size`: The number of features.
- * `--vocab_size`: The total features of dataset.
- * `--emb_dim`: The dense embedding dimension of sparse feature.
- * `--deep_layers_dim`: The dimension of all deep layers.
- * `--deep_layers_act`: The activation of all deep layers.
- * `--keep_prob`: The rate to keep in dropout layer.
- * `--ckpt_path`:The location of the checkpoint file.
- * `--eval_file_name` : Eval output file.
- * `--loss_file_name` : Loss output file.
-
- To train the model in one device, command as follows:
- ```
- python train.py
- ```
- Arguments:
- * `--data_path`: This should be set to the same directory given to the data_download's data_dir argument.
- * `--epochs`: Total train epochs.
- * `--batch_size`: Training batch size.
- * `--eval_batch_size`: Eval batch size.
- * `--field_size`: The number of features.
- * `--vocab_size`: The total features of dataset.
- * `--emb_dim`: The dense embedding dimension of sparse feature.
- * `--deep_layers_dim`: The dimension of all deep layers.
- * `--deep_layers_act`: The activation of all deep layers.
- * `--keep_prob`: The rate to keep in dropout layer.
- * `--ckpt_path`:The location of the checkpoint file.
- * `--eval_file_name` : Eval output file.
- * `--loss_file_name` : Loss output file.
-
- To train the model in distributed, command as follows:
- ```
- # configure environment path, RANK_TABLE_FILE, RANK_SIZE, MINDSPORE_HCCL_CONFIG_PATH before training
- bash run_multinpu_train.sh
- ```
-
- To evaluate the model, command as follows:
- ```
- python test.py
- ```
- Arguments:
- * `--data_path`: This should be set to the same directory given to the data_download's data_dir argument.
- * `--epochs`: Total train epochs.
- * `--batch_size`: Training batch size.
- * `--eval_batch_size`: Eval batch size.
- * `--field_size`: The number of features.
- * `--vocab_size`: The total features of dataset.
- * `--emb_dim`: The dense embedding dimension of sparse feature.
- * `--deep_layers_dim`: The dimension of all deep layers.
- * `--deep_layers_act`: The activation of all deep layers.
- * `--keep_prob`: The rate to keep in dropout layer.
- * `--ckpt_path`:The location of the checkpoint file.
- * `--eval_file_name` : Eval output file.
- * `--loss_file_name` : Loss output file.
-
- There are other arguments about models and training process. Use the `--help` or `-h` flag to get a full list of possible arguments with detailed descriptions.
|