Browse Source

[DOC] modify table format

tags/v0.3.2
Gene 2 years ago
parent
commit
fe8c9b2f63
1 changed files with 22 additions and 16 deletions
  1. +22
    -16
      docs/start/exp.rst

+ 22
- 16
docs/start/exp.rst View File

@@ -84,17 +84,17 @@ Consequently, while the market's learnwares from the PFS dataset undertake tasks
we tested various heterogeneous learnware reuse methods (without using user's labeled data) and compared them to the user's self-trained model based on a small amount of training data.
The average MSE performance across 41 users are as follows:

+------------------------------------+---------------------+
| Mean in Market (Single) | 1.459 +/- 1.066 |
+------------------------------------+---------------------+
| Best in Market (Single) | 1.226 +/- 1.032 |
+------------------------------------+---------------------+
| Top-1 Reuse (Single) | 1.407 +/- 1.061 |
+------------------------------------+---------------------+
| Average Ensemble Reuse (Multiple) | 1.312 +/- 1.099 |
+------------------------------------+---------------------+
| User model with 50 labeled data | 1.267 +/- 1.055 |
+------------------------------------+---------------------+
+---------------------------------------+---------------------+
| **Mean in Market (Single)** | 1.459 +/- 1.066 |
+---------------------------------------+---------------------+
| **Best in Market (Single)** | 1.226 +/- 1.032 |
+---------------------------------------+---------------------+
| **Top-1 Reuse (Single)** | 1.407 +/- 1.061 |
+---------------------------------------+---------------------+
| **Average Ensemble Reuse (Multiple)** | 1.312 +/- 1.099 |
+---------------------------------------+---------------------+
| **User model with 50 labeled data** | 1.267 +/- 1.055 |
+---------------------------------------+---------------------+

From the results, it is noticeable that the learnware market still perform quite well even when users lack labeled data,
provided it includes learnwares addressing tasks that are similar but not identical to the user's.
@@ -143,11 +143,17 @@ Results

The accuracy of search and reuse is presented in the table below:

==================== ================================= ================================= ================================= =================================
Top-1 Reuse Job Selector Reuse Average Ensemble Reuse Best in Market Average in Market
==================== ================================= ================================= ================================= =================================
0.846 +/- 0.054 0.845 +/- 0.053 0.862 +/- 0.051 0.859 +/- 0.051 0.507 +/- 0.030
==================== ================================= ================================= ================================= =================================
+--------------------------------------+---------------------+
| **Mean in Market (Single)** | 0.507 +/- 0.030 |
+--------------------------------------+---------------------+
| **Best in Market (Single)** | 0.859 +/- 0.051 |
+--------------------------------------+---------------------+
| **Top-1 Reuse (Single)** | 0.846 +/- 0.054 |
+--------------------------------------+---------------------+
| **Job Selector Reuse (Multiple)** | 0.845 +/- 0.053 |
+--------------------------------------+---------------------+
|**Average Ensemble Reuse (Multiple)** | 0.862 +/- 0.051 |
+--------------------------------------+---------------------+

* ``test_labeled``:



Loading…
Cancel
Save