Skip to content

报错 RuntimeError: Invalid UTF-8 sentence! #724

@Ech0Sakura

Description

@Ech0Sakura

ltp为4.2.0。代码如下
`

    output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"])
    seg = output.get("cws")[0]
    postags = output.get("pos")[0]
    arcs = output.get("dep")[0]
    roles = output.get("srl")[0]

`

结果报错:

Traceback (most recent call last):
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 190, in
triple = extractor.triples_main(row['输入文本'])
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 170, in triples_main
words, postags, child_dict_list, roles_dict, arcs = self.parser.parser_main(sentence)
File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 47, in parser_main
output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"])
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper
return func(*args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 185, in pipeline
store[task] = self.post[task](result, hidden, store, inputs, tokenized)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper
return func(*args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in _cws_post
words = [self.hook.hook(t, w) for t, w in zip(inputs, words)]
File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in
words = [self.hook.hook(t, w) for t, w in zip(inputs, words)]
RuntimeError: Invalid UTF-8 sentence!

看全网都没有遇到这个报错。有人知道吗

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions