[目的/意义]在多模态信息资源日益丰富的背景下，跨模态信息组织方式对非遗信息资源序化存储与共享利用具有重要价值。文章提出一种基于图文数据的非遗跨模态知识图谱构建方法。[方法/过程]文章通过结合多模态信息抽取与知识图谱技术对非遗数字资源进行知识重组。首先，从非遗项目内容与模态维度设计非遗跨模态知识图谱模式层，为图文数据组织提供顶层设计；其次，分别讨论面向非遗领域的图像与文本资源的知识抽取方案，获取图文模态下的非遗知识，并验证知识抽取方法的有效性；最后，通过面向不同场景下的一系列跨模态知识链接方法抽取非遗图文实体间的跨模态关系。[结果/结论]以楚剧非遗项目为例，通过多数据源、多技术结合的方式构建楚剧跨模态知识图谱，验证了文章所提出构建方法的可行性，对非遗数字化建设具有一定参考价值。

[Purpose/significance] Under the background of increasingly rich multimodal information resources, cross modal information organization has important value for the sequential storage and sharing of intangible cultural heritage information resources. This paper proposes a method of constructing intangible cultural heritage cross modal knowl⁃edge graph for image and text data. [Method/process] This paper combined multimodal information extraction and knowledge graph technology to reorganize the knowledge of intangible cultural heritage digital resources. Firstly, the schema layer of intangible cultural heritage cross modal knowledge graph is designed from the content and modal di⁃mensions of intangible cultural heritage digital resources to provide top-level design for graphic data organization. Sec⁃ondly, this paper discusses the knowledge extraction scheme of image and text resources in the field of intangible cultur⁃al heritage, obtains the intangible cultural heritage knowledge in the mode of image and text, and verifies the effective⁃ness of the knowledge extraction method. Finally, a series of cross modal knowledge linking methods for different scenes are used to extract the cross-modal relationships between intangible cultural heritage graphic entities. [Result/
conclusion] Taking the intangible cultural heritage project of Chu opera as an example, the cross-modal knowledge graph of Chu opera was constructed through the combination of multiple data sources and technologies, which verified the feasibility of the construction method proposed in this study, and had a certain reference value for the digital con⁃struction of intangible cultural heritage.