You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

add run_pipeline example Former-commit-id: fca1940bc01a73ecf9413d0eba41baf6263c829e [formerly 358cacbca0738aef391a5f26737cf40458070051] [formerly 6ec74d30308ca701d4e6f6ace8cbfe1a368f9238 [formerly bca1f9eff4f60d74848a2f7ed6bf08d584de77f2]] [formerly 40a471ebbc49f94a417b739194aab17af7edb389 [formerly 5ff1322a4f354e39aad11a5b746d92eabda3efd0] [formerly 01067f35f6c57cc5c5d8b78fb0a6277f69e58c4a [formerly d589fd6fa3452016cafeefbef8b489f668b3473c]]] [formerly 28c75141e72300274c1a013ce1b004f63e1a6cf8 [formerly 6504576ef9f0e0bec756e4e8fad02f654af745db] [formerly 479ecfa70c9e7d4dde80e9e98562498222077f40 [formerly 67352181a3cb46934c8ad941f8dbf6b3cd75a5e0]] [formerly 24fc56bc64172bc5571249e0c068a0eec046d610 [formerly d2e1003c89e280cbd72b2bcd419ee802d027cd2c] [formerly 2c820b46dbd384210a212bdfbc5d8692b09544bc [formerly 2f998f6974443b292926b6fb263f4e506d213cab]]]] [formerly 2468061ced237b6446ec399fd27cf48e8d6dec0f [formerly ee14c316a3307c0dae567bc8edb59db6c4be838f] [formerly 8965b7e537b64d81b918ef249bcd921a1fd94705 [formerly 8616cc1f24257dbdcb7f23b2bbe91fa0c1acf9d2]] [formerly 7dc2aa07c7f329be6fe9049107e215e8f62747ec [formerly b01f950dce65382d35e40f63497d2ca9fa65f447] [formerly 9eaf47ee443beaf9cdcaa093446f6c2f49e9e070 [formerly 733d64d92dd450030a32511fecb35e91287f4fa2]]] [formerly d22278c8d7fe41c4046e090ba28df1f2113bcaba [formerly 36f84cc80a3729c8c4c359c8797abd716844d4ce] [formerly e253cd18001f774eacfd44f71f7e4057f5993453 [formerly a4efdcb4908a1063985992e6d3a80af1753f4878]] [formerly 59f8404f2906a4c239fc973f8c3d5e972d868b40 [formerly c16238aeac376994c4a5140eeff37422c2aa23ed] [formerly 44bc1fed727c0e4179188da86453aff9fd20b1b8 [formerly befce4e2adfba17bb3b4aea6b31a92864fddbc30]]]]] [formerly 9dc9a2c1c0a911d002b6aa76b11990fc807d505a [formerly c3229cdf9ed082ebbfa7abecc938e3c1df67bbe8] [formerly 8de292e3ffe2687c35b961648b2895b9f1de9aec [formerly bfc083a3b684a67fe4a943bce91eed11ce10310f]] [formerly ab9519d4f7223a55a9d80f0218cd86552b55b3ea [formerly 1051e5930ac2571ec3e2af4d9344f29834fa3a97] [formerly 6994480a6c29a12d68418672ab605e00e1343cc6 [formerly 9efb04dedf1d85e938dc252fd7485392a8c594d3]]] [formerly 004687993bfff7f0137ca1272d254ba42ce71e37 [formerly 9a3ba544cbe5ea4819ab510d1a39814074098cd9] [formerly 7edab429ae94a0ac67f0f5d313634b39518a6cd5 [formerly c8b0fe59e216f7b7f09b4fcb39219fe888bbfc1f]] [formerly 1156340669052a9af0735312db25a28d71bbddb9 [formerly 195d7167e1e6736f2cfdb5c89bad82c8be0fc685] [formerly d05a060123a85aed5ed7cc30ffc8ee120e480be7 [formerly fea8332703ee9d091c8d70558eff358b9c9a3753]]]] [formerly b7c7af47accc23133f6c0bbb8be4baa59928bb24 [formerly 6cc66907a86d465bdbd02b42fe04be6a2dffa347] [formerly a9562377f6a869bb0188d58e1b718ff942418e5e [formerly f17f25a823502b73eb90f3dd5a011b29c6368548]] [formerly c7bcf7f4999d250874c38aa4cc00e51bb7c7cbb0 [formerly 7e5270c8b180a196f96c2aa1fd0d7432e96783a8] [formerly d8a1e00c0e559339b2b99f72bef85327bc053416 [formerly 8a3ddff8964bf71dfc91d850775256dae785099b]]] [formerly 0dce0b991e41969affbe5d99d73e3bf3c45a7253 [formerly 55d997b2a38d13a8f842a824c43076dcbd1a0409] [formerly d50a27d23acbd11981cac0c25819e1224dafc443 [formerly 71a554278c7e4a4be32976bbf3edbea64173bfef]] [formerly 838444a6cbb1296707958c10b4812cf72168fb65 [formerly a6147af1df6665c88fce674e88d644e5cff88365] [formerly 97b80b640074f978892fccf02f3c888dae391502 [formerly 6bb1e359c4ac430770981e41c4b149552ac0685f]]]]]] Former-commit-id: 24bbedc26a24d9a4c1731cd1aa5e74b732f9e9b6 [formerly d30bc965a1665f1bf59eb50c544480f54aa54914] [formerly ce97c9d016e34a30e79b50471f394c65a284370f [formerly b92e7af1607ca8d4b236e97d7d7580d966cc9e8a]] [formerly bc39ea4b86d4239e1f3f6f6e479c79bd9e2364da [formerly de937a558f3e9340f48c0b02e75ca6f2d539f2be] [formerly f028743fbf1db54407e0b25de75eceee1c4d60a5 [formerly 8395df862a6c760c32a7064173e13719341bf3cb]]] [formerly cb7bf8e888e2fbc50d911bb63dfc4d1dec8aa897 [formerly 9076a02479bd09cff997b1934595110dc2b62aaf] [formerly 3bfecdb558319afee2a06b1dabd465df20ee1a0b [formerly c06c4451c75ad069701f94f158768999320cacb8]] [formerly f85a40bf61151f0ac8ebe91077d85d1913fda894 [formerly f6b5fcd73f157de1079815413e5998a83eb5c177] [formerly 1c7c12f8deabc5c489f89561dafd2a69dea075de [formerly f8876d15fd5c73fd62132de30e95ff03be3f46a6]]]] [formerly ebdbbb16d82c53dae0c7e3bc071d22aec64b0511 [formerly 90aea8bb089c83627c092da8fbd3da1d5a424bb5] [formerly 0dadf699f7711afee0866523ad34479658bebc6d [formerly 661ac2ff82d9ea8dd0ecdb0ba49de7eec0c44d70]] [formerly a9ba16524513e9660c07dafcbd2497320575b752 [formerly 45760ac2eb89786bf05f6dd10fa872ea476aab7d] [formerly c047334390289ac9bf8f121be94dd3f62a35c249 [formerly 56b517dc66f0a81c0ca75d01e18c3e26dc4a58bb]]] [formerly 536811c453a4cfb78402dff8680f8dd78eb9911a [formerly 5ec3de637001b7ab1a14c713db19c69760a6959c] [formerly a91e41774e1886840e11198c0e13aac96d77271e [formerly 076c5f4bdd99e6feb6ebcb764b966bbd63862b89]] [formerly 2f526d129cb03cb907b9dbc8bfa43a6255ecde9b [formerly befa3b01216fe7d0816c2834763a282f7b892682] [formerly 97b80b640074f978892fccf02f3c888dae391502]]]] Former-commit-id: 844fcc10535a0cb2b68f8a9fa356580424d6be0d [formerly b9417a7909f0c3f66be8bd5a9f323bc4c007fc65] [formerly 7de8c22b60945b08525f251f80321799802e96ee [formerly 3f99f9cd14efc49d59aaf49afbf8bd150ba68e47]] [formerly ced1db2fe8acf3e79dddc88af09795ae3cfffd9b [formerly 1a1f6085a0f2dde78dff98fff38d5ac0c363b560] [formerly ecded0b584720d3dd01046b343edb7ac23f785b0 [formerly fe14c8dec2a0dd9ecc9fe810965c7917323c3988]]] [formerly c0249580506ee6062e751bead368d63c68fd56ed [formerly 927c066af53099983e4b6dce554e76dc36de0e01] [formerly 22e544266cf9ffbd29fa58cf0e6211769bf87f29 [formerly 1c38f4088ec7981d41e74c9c80696385f6541c4b]] [formerly d9369fb4b667cde0c0d3748cd398f2ba9d836c69 [formerly 6e5bda10632b577f58b58d80dcc7d6e275fc0a38] [formerly fdbe618e2a7cadec29cad59209864cd00d678d74 [formerly 5b20e98644622153333d6b5cc6b1f5ec1c29f759]]]] Former-commit-id: 557791dbf48dcfe72f9c77ab4dae990682d0ccd1 [formerly 344e05a0088f253f8e52e84cfe1c1593cfbe2625] [formerly 1a52c34b359d7ad4de84dab50d5d08199f1b64d7 [formerly ed1287afd1db3dcd2a964365355e45cca944e1d4]] [formerly c0fc7d644f1a5b005e6050ba3e98d960ccf8650e [formerly 46468fa4ff61ec11af3c7a1090b777ec2beffebc] [formerly 04e4ccc0f421cbd7f77438398374889b5d7907de [formerly d8f4305146d18d27aba906d7b588911ead4033b7]]] Former-commit-id: a5e5a2c8dabbfec0d099c95aa49d893014df726f [formerly 851a5acd34dce32344ba9a9ffc1e6137a8db4b76] [formerly d3d6bc516150bdbcee33f11dc382ceee37f53e32 [formerly d5e29f7c9bf84b87162ba3bbeb026e7b7493ca1c]] Former-commit-id: 855d9fd52887e42e8bc2ecd45e5ac6b95527e389 [formerly a69cbe46e78e5acda6ada2fbb5aad9ab6234dd71] Former-commit-id: 9a6a89962ccfc220e8c4d1b81c796a156598954e
5 years ago
123456789101112131415161718192021222324252627282930313233343536373839
  1. Overview
  2. ========
  3. Design Principles
  4. ~~~~~~~~~~~~~~~~~
  5. TODS follows the design principal of `D3M <http://datadrivendiscovery.org/>`_.
  6. The toolkit wraps each function into ``Primitive`` class with unified
  7. interfaces. The goal of this toolkit is to enable the users to easily develop
  8. outlier detection system for time series data. The following design principles
  9. are applied when developing the toolkit:
  10. * **.** Results on the environments can be reproduced. The same result should be obtained with the same random seed in different runs.
  11. * **Accessible.** The experiences are collected and well organized after each game with easy-to-use interfaces. Uses can conveniently configure state representation, action encoding, reward design, or even the game rules.
  12. * **Scalable.** New card environments can be added conveniently into the toolkit with the above design principles. We also try to minimize the dependencies in the toolkit so that the codes can be easily maintained.
  13. TODS High-level Design
  14. ~~~~~~~~~~~~~~~~~~~~~~~~
  15. .. image:: img/framework.pdf
  16. :width: 800
  17. Data Processing
  18. ---------------
  19. Timeseries Processing
  20. ---------------------
  21. Feature Analysis
  22. ----------------
  23. Detection Algorithms
  24. ---------------------
  25. Reincforcement
  26. --------------

全栈的自动化机器学习系统,主要针对多变量时间序列数据的异常检测。TODS提供了详尽的用于构建基于机器学习的异常检测系统的模块,它们包括:数据处理(data processing),时间序列处理( time series processing),特征分析(feature analysis),检测算法(detection algorithms),和强化模块( reinforcement module)。这些模块所提供的功能包括常见的数据预处理、时间序列数据的平滑或变换,从时域或频域中抽取特征、多种多样的检测算