Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[错误报告]下载番剧完成后，出现parse失败，直接删除torrent和文件 #794

Open
4 tasks done
chunner opened this issue Jul 5, 2024 · 6 comments
Open
4 tasks done

[错误报告]下载番剧完成后，出现parse失败，直接删除torrent和文件 #794

chunner opened this issue Jul 5, 2024 · 6 comments
Labels
bug Something isn't working

Comments

@chunner
Copy link

chunner commented Jul 5, 2024 •
edited
Loading

确认

  • 我已经查阅了已知问题，并确认我的问题不在其中。
  • 我的版本是最新版本，我的版本号与 version 相同。
  • 我已经 issue 中搜索过，确认我的问题没有被提出过。
  • 我已经修改标题，将标题中的 描述 替换为我遇到的问题。

当前程序版本

3.1.14

问题类型

程序运行问题

问题描述

订阅了mikan中的番剧后，等下载完成后，报parse失败，直接删除torrent和视频文件。之前订阅其他番剧时都是正常的。

发生问题时系统日志

[2024-07-05 23:09:52] DEBUG:    Using selector: EpollSelector
[2024-07-05 23:09:52] INFO:     Started server process [7]
[2024-07-05 23:09:52] INFO:     Waiting for application startup.
[2024-07-05 23:09:52] INFO:     
[2024-07-05 23:09:52] INFO:                     _        ____                                    _
[2024-07-05 23:09:52] INFO:          /\        | |      |  _ \                                  (_)
[2024-07-05 23:09:52] INFO:         /  \  _   _| |_ ___ | |_) | __ _ _ __   __ _ _   _ _ __ ___  _
[2024-07-05 23:09:52] INFO:        / /\ \| | | | __/ _ \|  _ < / _` | '_ \ / _` | | | | '_ ` _ \| |
[2024-07-05 23:09:52] INFO:       / ____ \ |_| | || (_) | |_) | (_| | | | | (_| | |_| | | | | | | |
[2024-07-05 23:09:52] INFO:      /_/    \_\__,_|\__\___/|____/ \__,_|_| |_|\__, |\__,_|_| |_| |_|_|
[2024-07-05 23:09:52] INFO:                                                 __/ |
[2024-07-05 23:09:52] INFO:                                                |___/
[2024-07-05 23:09:52] INFO:     Version 3.1.14  Author: EstrellaXD Twitter: https://twitter.com/Estrella_Pan
[2024-07-05 23:09:52] INFO:     GitHub: https://github.com/EstrellaXD/Auto_Bangumi/
[2024-07-05 23:09:52] INFO:     Starting AutoBangumi...
[2024-07-05 23:09:52] INFO:     Config loaded
[2024-07-05 23:09:52] DEBUG:    Starting new HTTP connection (1): 
[2024-07-05 23:09:52] DEBUG:    "GET / HTTP/1.1" 200 649
[2024-07-05 23:09:52] DEBUG:    Re-initializing context...
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] INFO:     Program running.
[2024-07-05 23:09:52] INFO:     Application startup complete.
[2024-07-05 23:09:52] INFO:     Uvicorn running on http://0.0.0.0:7892 (Press CTRL+C to quit)
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:09:52] DEBUG:    [Engine] Get 3 RSS items
[2024-07-05 23:09:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:09:52] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3240&subgroupid=370. Status: 200
[2024-07-05 23:09:52] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:09:53] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3407&subgroupid=583. Status: 200
[2024-07-05 23:09:53] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:09:54] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:09:54] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:10:24] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_name with data[0:8]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_data with data[9:14]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_name with data[15:23]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_data with data[24:34]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_end with no data
[2024-07-05 23:10:24] DEBUG:    detected 'bcrypt' backend, version '4.0.1'
[2024-07-05 23:10:24] DEBUG:    'bcrypt' backend lacks $2$ support, enabling workaround
[2024-07-05 23:10:35] DEBUG:    [Database] Find bangumi id: 17.
[2024-07-05 23:10:35] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:35] DEBUG:    [Database] Delete bangumi id: 17.
[2024-07-05 23:10:35] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:35] INFO:     [Manager] Delete rule for 鹿乃子乃子乃子虎视眈眈
[2024-07-05 23:10:48] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:10:48] DEBUG:    RAW:[北宇治字幕组] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan [01][先行版][WebRip][HEVC_AAC][繁日内嵌] >> Shikanoko Nokonoko Koshitantan
[2024-07-05 23:10:49] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/71a2d5e1ab043d6dbb490d089329f222f610181c. Status: 200
[2024-07-05 23:10:49] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
[2024-07-05 23:10:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:10:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:11:46] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_name with data[0:8]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_data with data[9:14]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_name with data[15:23]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_data with data[24:34]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_end with no data
[2024-07-05 23:11:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:11:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:11:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:12:23] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:12:23] DEBUG:    RAW:[北宇治字幕组] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan [01][先行版][WebRip][HEVC_AAC][繁日内嵌] >> Shikanoko Nokonoko Koshitantan
[2024-07-05 23:12:24] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/71a2d5e1ab043d6dbb490d089329f222f610181c. Status: 200
[2024-07-05 23:12:24] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
[2024-07-05 23:12:33] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:33] DEBUG:    RSS Item https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611 not exists, adding...
[2024-07-05 23:12:33] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:12:33] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:34] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/71a2d5e1ab043d6dbb490d089329f222f610181c.torrent. Status: 200
[2024-07-05 23:12:34] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/50435c2c43d586ddd6500521ce951d4b4cc15d8a.torrent. Status: 200
[2024-07-05 23:12:34] DEBUG:    [Downloader] Add torrent: 鹿乃子乃子乃子虎视眈眈
[2024-07-05 23:12:34] DEBUG:    Insert 2 torrents in database.
[2024-07-05 23:12:34] DEBUG:    [Database] Insert 鹿乃子乃子乃子虎视眈眈 into database.
[2024-07-05 23:12:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:12:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:13:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:13:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:13:52] WARNING:  [Renamer] [KitaujiSub] Shikanoko Nokonoko Koshitantan [01Pre][WebRip][HEVC_AAC][CHS_JP].mp4 parse failed
[2024-07-05 23:13:52] INFO:     [Downloader] Remove torrents.
[2024-07-05 23:13:52] WARNING:  [Renamer] [KitaujiSub] Shikanoko Nokonoko Koshitantan [01Pre][WebRip][HEVC_AAC][CHT_JP].mp4 parse failed
[2024-07-05 23:13:52] INFO:     [Downloader] Remove torrents.
[2024-07-05 23:13:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:14:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:14:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:14:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:15:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:15:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:15:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:16:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:16:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:16:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:17:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:17:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:17:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:18:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:18:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:18:53] DEBUG:    [Renamer] Rename process finished.
@chunner chunner added the bug Something isn't working label Jul 5, 2024
@chunner
Copy link
Author

chunner commented Jul 6, 2024 •
edited
Loading

订阅另一个字幕组，没有问题

2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382. Status: 200
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    RAW:【喵萌奶茶屋】★07月新番★[鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan][01][1080p][简体][招募翻译] >> Shikanoko Nokonoko Koshitantan
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/a9884ff88155befab373b430ed21931954335275. Status: 200
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
2024-07-06 08:53:54 ab  | [2024-07-06 08:53:54] DEBUG:    [Downloader] Authed.
2024-07-06 08:53:54 ab  | [2024-07-06 08:53:54] DEBUG:    RSS Item https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382 not exists, adding...
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382. Status: 200
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Downloader] Authed.
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/a9884ff88155befab373b430ed21931954335275.torrent. Status: 200
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Downloader] Add torrent: 鹿乃子乃子乃子虎视眈眈
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    Insert 1 torrents in database.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Downloader] Authed.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Renamer] Start rename process.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] INFO:     [Nekomoe kissaten][Shikanoko Nokonoko Koshitantan][01][1080p][CHS].mp4 >> 鹿乃子乃子乃子虎视眈眈 S01E01.mp4
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Renamer] Rename process finished.
2024-07-06 08:54:47 ab  | [2024-07-06 08:54:47] DEBUG:    Telegram notification: 200
2024-07-06 08:54:47 ab  | [2024-07-06 08:54:47] DEBUG:    Send notification: 鹿乃子乃子乃子虎视眈眈
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Downloader] Authed.
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Renamer] Start rename process.
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Renamer] Rename process finished.

@ResidualBlood
Copy link
Contributor

ResidualBlood commented Jul 7, 2024 •
edited
Loading

一样的番剧
WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕].
只不过我是这个错误

@yorktownting
Copy link

一样的番剧 WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]. 只不过我是这个错误

同，好像只有这个torrent会出问题。

@YipSzeho
Copy link

YipSzeho commented Jul 8, 2024

同样问题

@yorktownting
Copy link

一样的番剧 WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]. 只不过我是这个错误

同，好像只有这个torrent会出问题。

试了下本地跑这个test用例是能过的……没明白是什么情况

def test_parse_without_openai(self):
    text = "[喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]"
    result = TitleParser.raw_parser(text)

@Jeremy-Hibiki
Copy link
Contributor

Jeremy-Hibiki commented Jul 10, 2024 •
edited
Loading

debug 看了一下，这条 RSS 解析出来是

[喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan\n- 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]

image

当中不是空格，是\n。然后经过

Auto_Bangumi/backend/src/module/parser/analyser/raw_parser.py

Line 134 in 7913061

raw_title = raw_title.strip().replace("\n", "")

又把\n给吞掉了

Jeremy-Hibiki added a commit to Jeremy-Hibiki/Auto_Bangumi that referenced this issue Jul 14, 2024
@Jeremy-Hibiki
feat: fix multi-line title post-processing in raw_parser
b61ceb3 
close EstrellaXD#679, EstrellaXD#794
related pr EstrellaXD#685
@Jeremy-Hibiki Jeremy-Hibiki mentioned this issue Jul 14, 2024
Merged
Jeremy-Hibiki added a commit to Jeremy-Hibiki/Auto_Bangumi that referenced this issue Jul 14, 2024
@Jeremy-Hibiki
fix: fix multi-line title post-processing in raw_parser
89f0754 
close EstrellaXD#679, EstrellaXD#794
related pr EstrellaXD#685
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@ResidualBlood @yorktownting @YipSzeho @Jeremy-Hibiki @chunner