Browse Source

[ENH] add mnist performance to docs

pull/5/head
Gao Enhao 2 years ago
parent
commit
20f5c09456
3 changed files with 32 additions and 0 deletions
  1. +6
    -0
      docs/Examples/MNISTAdd.rst
  2. +16
    -0
      examples/mnist_add/README.md
  3. +10
    -0
      examples/mnist_add/mnist_add.ipynb

+ 6
- 0
docs/Examples/MNISTAdd.rst View File

@@ -392,6 +392,12 @@ Log:
Performance
-----------

We present the results of ABL as follows, which include the reasoning accuracy (the proportion of equations that are correctly summed), and the training time used to achieve this accuracy. These results are compared with the following methods:

- `NeurASP <https://github.com/azreasoners/NeurASP>`_: An extension of answer set programs by treating the neural network output as the probability distribution over atomic facts;
- `DeepProbLog <https://github.com/ML-KULeuven/deepproblog>`_: An extension of ProbLog by introducing neural predicates in Probabilistic Logic Programming;
- `DeepStochLog <https://github.com/ML-KULeuven/deepstochlog>`_: A neural-symbolic framework based on stochastic logic program.

.. table::
:class: centered



+ 16
- 0
examples/mnist_add/README.md View File

@@ -43,3 +43,19 @@ optional arguments:
--ground use GroundKB (default: False)

```


## Performance

We present the results of ABL as follows, which include the reasoning accuracy (the proportion of equations that are correctly summed), and the training time used to achieve this accuracy. These results are compared with the following methods:

- [**NeurASP**](https://github.com/azreasoners/NeurASP): An extension of answer set programs by treating the neural network output as the probability distribution over atomic facts;
- [**DeepProbLog**](https://github.com/ML-KULeuven/deepproblog): An extension of ProbLog by introducing neural predicates in Probabilistic Logic Programming;
- [**DeepStochLog**](https://github.com/ML-KULeuven/deepstochlog): A neural-symbolic framework based on stochastic logic program.

| Method | Accuracy | Time to achieve the Acc. (s) |
| :----------: | :------: | :--------------------------: |
| NeurASP | 0.964 | 354 |
| DeepProbLog | 0.965 | 1965 |
| DeepStochLog | 0.975 | 727 |
| ABL | 0.980 | 42 |

+ 10
- 0
examples/mnist_add/mnist_add.ipynb View File

@@ -465,6 +465,16 @@
"## Performance"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We present the results of ABL as follows, which include the reasoning accuracy (the proportion of equations that are correctly summed), and the training time used to achieve this accuracy. These results are compared with the following methods:\n",
"- [**NeurASP**](https://github.com/azreasoners/NeurASP): An extension of answer set programs by treating the neural network output as the probability distribution over atomic facts;\n",
"- [**DeepProbLog**](https://github.com/ML-KULeuven/deepproblog): An extension of ProbLog by introducing neural predicates in Probabilistic Logic Programming;\n",
"- [**DeepStochLog**](https://github.com/ML-KULeuven/deepstochlog): A neural-symbolic framework based on stochastic logic program."
]
},
{
"cell_type": "markdown",
"metadata": {},


Loading…
Cancel
Save