Difference between revisions of "Dsc:progress"
(→相关论文) |
(→相关论文) |
||
Line 19: | Line 19: | ||
系统: | 系统: | ||
+ | # [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/li_mu Scaling Distributed Machine Learning with the Parameter Server (OSDI 2014)] | ||
+ | # [http://jos.org.cn/jos/ch/reader/create_pdf.aspx?file_no=5376&year_id=2018&quarter_id=1&falg=1 可扩展机器学习的并行与分布式优化算法综述 (软件学报 2017)] | ||
+ | # [https://academic.oup.com/nsr/article/5/2/216/3052720?login=true Angel: a new large-scale machine learning system (National Science Review 2018)] | ||
# [https://arxiv.org/abs/1903.12287 PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)] | # [https://arxiv.org/abs/1903.12287 PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)] | ||
− | # [https:// | + | # [https://arxiv.org/abs/2006.15704 PyTorch Distributed: Experiences on Accelerating Data Parallel Training (VLDB 2020)] |
− | # | + | # [http://www.jos.org.cn/jos/ch/reader/create_pdf.aspx?file_no=6186&journal_id=jos 图嵌入算法分布式优化 (软件学报 2020)] |
+ | # [https://ieeexplore.ieee.org/abstract/document/9272876/ EDGES: An Efficient Distributed Graph Embedding System on GPU clusters (TPDS 2020)] | ||
+ | # [https://arxiv.org/abs/2009.02963 TORCHKGE: KNOWLEDGE GRAPH EMBEDDING IN PYTHON AND PYTORCH (Arxiv 2020)] | ||
== State of the art工作 == | == State of the art工作 == |
Revision as of 07:54, 25 January 2021
Contents
研究目标
- 基于PyTorch底层API,设计容纳翻译模型(Trans系列)的分布式表示学习算法,以支持大规模知识图谱分布式表示学习
- 权衡计算通信代价,优化训练过程,在准确率不降低(或少量降低)的前提下,减少训练时间,提升效率
- 在真实知识图谱(DBpedia,Wikidata等)上进行对比实验,验证算法的准确性、高效性和可扩展性
相关论文
综述:
模型:
- Translating Embeddings for Modeling Multi-relational Data (NIPS 2013)
- Knowledge Graph Embedding by Translating on Hyperplanes (AAAI 2014)
- Learning Entity and Relation Embeddings for Knowledge Graph Completion (AAAI 2015)
- Knowledge Graph Embedding via Dynamic Mapping Matrix (IJCNLP 2015)
- Differentiating Concepts and Instances for Knowledge Graph Embedding (EMNLP 2018)
系统:
- Scaling Distributed Machine Learning with the Parameter Server (OSDI 2014)
- 可扩展机器学习的并行与分布式优化算法综述 (软件学报 2017)
- Angel: a new large-scale machine learning system (National Science Review 2018)
- PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)
- PyTorch Distributed: Experiences on Accelerating Data Parallel Training (VLDB 2020)
- 图嵌入算法分布式优化 (软件学报 2020)
- EDGES: An Efficient Distributed Graph Embedding System on GPU clusters (TPDS 2020)
- TORCHKGE: KNOWLEDGE GRAPH EMBEDDING IN PYTHON AND PYTORCH (Arxiv 2020)
State of the art工作
- PyTorch-Biggraph
- PS-Graph
- AliGraph
- DGL-KE
工具包
国内外相关课题组
- 北京大学 崔斌教授组