Difference between revisions of "Dsc:progress"
(→State of the art工作) |
(→相关论文) |
||
| Line 23: | Line 23: | ||
# [https://academic.oup.com/nsr/article/5/2/216/3052720?login=true Angel: a new large-scale machine learning system (National Science Review 2018)] | # [https://academic.oup.com/nsr/article/5/2/216/3052720?login=true Angel: a new large-scale machine learning system (National Science Review 2018)] | ||
# [https://arxiv.org/abs/1903.12287 PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)] | # [https://arxiv.org/abs/1903.12287 PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)] | ||
| + | # [https://ieeexplore.ieee.org/abstract/document/9101887/ PSGraph: How Tencent trains extremely large-scale graphs with Spark? (ICDE 2020)] | ||
| + | # [https://dl.acm.org/doi/abs/10.1145/3292500.3340404 AliGraph: A Comprehensive Graph Neural Network Platform (KDD 2019)] | ||
# [https://arxiv.org/abs/2006.15704 PyTorch Distributed: Experiences on Accelerating Data Parallel Training (VLDB 2020)] | # [https://arxiv.org/abs/2006.15704 PyTorch Distributed: Experiences on Accelerating Data Parallel Training (VLDB 2020)] | ||
# [http://www.jos.org.cn/jos/ch/reader/create_pdf.aspx?file_no=6186&journal_id=jos 图嵌入算法分布式优化 (软件学报 2020)] | # [http://www.jos.org.cn/jos/ch/reader/create_pdf.aspx?file_no=6186&journal_id=jos 图嵌入算法分布式优化 (软件学报 2020)] | ||
Revision as of 07:59, 25 January 2021
Contents
研究目标
- 基于PyTorch底层API，设计容纳翻译模型（Trans系列）的分布式表示学习算法，以支持大规模知识图谱分布式表示学习
- 权衡计算通信代价，优化训练过程，在准确率不降低（或少量降低）的前提下，减少训练时间，提升效率
- 在真实知识图谱（DBpedia，Wikidata等）上进行对比实验，验证算法的准确性、高效性和可扩展性
相关论文
综述：
模型：
- Translating Embeddings for Modeling Multi-relational Data (NIPS 2013)
- Knowledge Graph Embedding by Translating on Hyperplanes (AAAI 2014)
- Learning Entity and Relation Embeddings for Knowledge Graph Completion (AAAI 2015)
- Knowledge Graph Embedding via Dynamic Mapping Matrix (IJCNLP 2015)
- Differentiating Concepts and Instances for Knowledge Graph Embedding (EMNLP 2018)
系统：
- Scaling Distributed Machine Learning with the Parameter Server (OSDI 2014)
- 可扩展机器学习的并行与分布式优化算法综述 (软件学报 2017)
- Angel: a new large-scale machine learning system (National Science Review 2018)
- PYTORCH-BIGGRAPH: A LARGE-SCALE GRAPH EMBEDDING SYSTEM (SysML 2019)
- PSGraph: How Tencent trains extremely large-scale graphs with Spark? (ICDE 2020)
- AliGraph: A Comprehensive Graph Neural Network Platform (KDD 2019)
- PyTorch Distributed: Experiences on Accelerating Data Parallel Training (VLDB 2020)
- 图嵌入算法分布式优化 (软件学报 2020)
- EDGES: An Efficient Distributed Graph Embedding System on GPU clusters (TPDS 2020)
- DGL-KE: Training Knowledge Graph Embeddings at Scale (SIGIR 2020)
- TORCHKGE: KNOWLEDGE GRAPH EMBEDDING IN PYTHON AND PYTORCH (Arxiv 2020)
State of the art工作
- PyTorch-Biggraph
- PS-Graph
- AliGraph
- DGL-KE
工具包
国内外相关课题组
- 北京大学 崔斌教授组
