yt-dlp crashed in MX19.4 making clipgrab no longer work.

[pianokeyjoe]

Hello my fellow MX lovers! I am in a bind once again with relations to Clipgrab and yt-dlp on my beloved MX linux 19.4. I was using clipgrab one day as usual and all was well, but the next day I could no longer download files with it. It immediatly fails with an error that no media found or url not found. My internet works fine so I checked the yt-dlp and it was downloading fin with clipgrab every time the app is started. Well today when I went to upgrade my web browser via synaptic package manager, I got an error about yt-dlp which was NOT what I was upgrading or messing with today.. it was google chrome. Please find both my QSI and a terminal output of the errors I got when I did a apt autoremove command this morning. Maybe you guys can make heads or tails of this and offer a solution besides upgrading my whole OS?

Code: Select all

System:    Kernel: 5.10.0-8mx-rt-amd64 x86_64 bits: 64 compiler: gcc v: 8.3.0 
           parameters: BOOT_IMAGE=/vmlinuz-5.10.0-8mx-rt-amd64 
           root=UUID=<filter> ro quiet splash 
           Desktop: Xfce 4.14.2 tk: Gtk 3.24.5 info: xfce4-panel wm: xfwm 4.14.0 vt: 7 
           dm: LightDM 1.26.0 Distro: MX-19.4_x64 patito feo October 21  2019 
           base: Debian GNU/Linux 10 (buster) 
Machine:   Type: Laptop System: Hewlett-Packard product: HP Pavilion g6 Notebook PC 
           v: 0594100000204610000620100 serial: <filter> Chassis: type: 10 serial: <filter> 
           Mobo: Hewlett-Packard model: 1693 v: KBC Version 14.16 serial: <filter> 
           BIOS: Hewlett-Packard v: F.37 date: 01/16/2013 
CPU:       Info: Dual Core model: Intel Core i3 M 380 bits: 64 type: MT MCP arch: Nehalem 
           family: 6 model-id: 25 (37) stepping: 5 microcode: 7 cache: L2: 3 MiB 
           flags: lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx bogomips: 20214 
           Speed: 1143 MHz min/max: 933/2533 MHz Core speeds (MHz): 1: 1143 2: 1183 3: 1088 
           4: 1155 
           Vulnerabilities: Type: itlb_multihit status: KVM: VMX disabled 
           Type: l1tf mitigation: PTE Inversion; VMX: conditional cache flushes, SMT vulnerable 
           Type: mds 
           status: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 
           Type: meltdown mitigation: PTI 
           Type: spec_store_bypass 
           mitigation: Speculative Store Bypass disabled via prctl and seccomp 
           Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer sanitization 
           Type: spectre_v2 mitigation: Full generic retpoline, IBPB: conditional, IBRS_FW, 
           STIBP: conditional, RSB filling 
           Type: srbds status: Not affected 
           Type: tsx_async_abort status: Not affected 
Graphics:  Device-1: Intel Core Processor Integrated Graphics vendor: Hewlett-Packard 
           driver: i915 v: kernel bus-ID: 00:02.0 chip-ID: 8086:0046 class-ID: 0300 
           Device-2: Microdia type: USB driver: uvcvideo bus-ID: 2-1.6:4 chip-ID: 0c45:6321 
           class-ID: 0e02 
           Display: x11 server: X.Org 1.20.10 compositor: xfwm4 v: 4.14.0 driver: loaded: intel 
           display-ID: :0.0 screens: 1 
           Screen-1: 0 s-res: 1366x768 s-dpi: 96 s-size: 361x203mm (14.2x8.0") 
           s-diag: 414mm (16.3") 
           Monitor-1: LVDS1 res: 1366x768 hz: 60 dpi: 101 size: 344x193mm (13.5x7.6") 
           diag: 394mm (15.5") 
           OpenGL: renderer: Mesa DRI Intel HD Graphics (ILK) v: 2.1 Mesa 20.3.5 
           direct render: Yes 
Audio:     Device-1: Intel 5 Series/3400 Series High Definition Audio vendor: Hewlett-Packard 
           driver: snd_hda_intel v: kernel bus-ID: 00:1b.0 chip-ID: 8086:3b56 class-ID: 0403 
           Sound Server-1: ALSA v: k5.10.0-8mx-rt-amd64 running: yes 
           Sound Server-2: JACK v: 1.9.12 running: no 
           Sound Server-3: PulseAudio v: 12.2 running: yes 
Network:   Device-1: Realtek RTL810xE PCI Express Fast Ethernet vendor: Hewlett-Packard 
           driver: r8169 v: kernel port: 3000 bus-ID: 01:00.0 chip-ID: 10ec:8136 class-ID: 0200 
           IF: eth0 state: up speed: 100 Mbps duplex: full mac: <filter> 
           Device-2: Qualcomm Atheros AR9285 Wireless Network Adapter 
           vendor: Hewlett-Packard U98Z062.12 802.11bgn driver: ath9k v: kernel port: 3000 
           bus-ID: 02:00.0 chip-ID: 168c:002b class-ID: 0280 
           IF: wlan0 state: up mac: <filter> 
Drives:    Local Storage: total: 465.76 GiB used: 349.54 GiB (75.0%) 
           SMART Message: Unable to run smartctl. Root privileges required. 
           ID-1: /dev/sda maj-min: 8:0 vendor: Seagate model: ST500LM034-2GH17A size: 465.76 GiB 
           block-size: physical: 4096 B logical: 512 B speed: 3.0 Gb/s type: HDD rpm: 7200 
           serial: <filter> rev: LXM3 scheme: MBR 
Partition: ID-1: / raw-size: 29.3 GiB size: 28.71 GiB (98.00%) used: 14.26 GiB (49.7%) fs: ext4 
           dev: /dev/sda3 maj-min: 8:3 
           ID-2: /boot raw-size: 512 MiB size: 487.9 MiB (95.30%) used: 137.3 MiB (28.1%) 
           fs: ext4 dev: /dev/sda1 maj-min: 8:1 
           ID-3: /home raw-size: 428.15 GiB size: 420.43 GiB (98.20%) used: 335.15 GiB (79.7%) 
           fs: ext4 dev: /dev/sda4 maj-min: 8:4 
Swap:      Kernel: swappiness: 15 (default 60) cache-pressure: 100 (default) 
           ID-1: swap-1 type: partition size: 7.81 GiB used: 0 KiB (0.0%) priority: -2 
           dev: /dev/sda2 maj-min: 8:2 
Sensors:   System Temperatures: cpu: 77.0 C mobo: 0.0 C 
           Fan Speeds (RPM): N/A 
Repos:     Packages: note: see --pkg apt: 3063 lib: 1440 flatpak: 0 
           No active apt repos in: /etc/apt/sources.list 
           Active apt repos in: /etc/apt/sources.list.d/debian-stable-updates.list 
           1: deb http://deb.debian.org/debian buster-updates main contrib non-free
           Active apt repos in: /etc/apt/sources.list.d/debian.list 
           1: deb http://deb.debian.org/debian buster main contrib non-free
           2: deb http://deb.debian.org/debian-security buster/updates main contrib non-free
           Active apt repos in: /etc/apt/sources.list.d/google-chrome.list 
           1: deb [arch=amd64] https://dl.google.com/linux/chrome/deb/ stable main
           Active apt repos in: /etc/apt/sources.list.d/mx.list 
           1: deb http://mxrepo.com/mx/repo/ buster main non-free
           2: deb http://mxrepo.com/mx/testrepo/ buster test
           3: deb http://mxrepo.com/mx/repo/ buster ahs
           No active apt repos in: /etc/apt/sources.list.d/various.list 
Info:      Processes: 235 Uptime: 1h 35m wakeups: 2 Memory: 7.58 GiB used: 2.05 GiB (27.1%) 
           Init: SysVinit v: 2.93 runlevel: 5 default: 5 tool: systemctl Compilers: gcc: 8.3.0 
           alt: 8 Shell: quick-system-in default: Bash v: 5.0.3 running-in: quick-system-in 
           inxi: 3.3.06 

And the terminal errors:

Code: Select all

Setting up yt-dlp (2024.08.06-1) ...
  File "/usr/lib/python3/dist-packages/yt_dlp/YoutubeDL.py", line 741
    if impersonate_target := self.params.get('impersonate'):
                           ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/downloader/common.py", line 374
    if update_delta := self.params.get('progress_delta'):
                     ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/downloader/hls.py", line 164
    if extra_param_to_segment_url := info_dict.get('extra_param_to_segment_url'):
                                   ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/banbye.py", line 145
    if master_url := traverse_obj(url_data, ('src', 'hls', 'masterPlaylist', {url_or_none})):
                   ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/bbc.py", line 1427
    if model and (entry := parse_model(model)):
                        ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/cbc.py", line 390
    if not assets and (media_id := traverse_obj(data, ('mediaId', {str}))):
                                ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/cellebrite.py", line 44
    if thumbnail := self._og_search_thumbnail(webpage, default=None):
                  ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/common.py", line 2227
    if yt_audio_content_id := last_stream_inf.get('YT-EXT-AUDIO-CONTENT-ID'):
                            ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/crtvg.py", line 42
    if mobj := re.fullmatch(r'[^/#?]+-(?P<old_id>\d{7})', video_id):
             ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/crunchyroll.py", line 65
    if target := error.cause.response.extensions.get('impersonate'):
               ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/dangalplay.py", line 135
    elif msg := error_info.get('message'):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/elementorembed.py", line 59
    if youtube_url := traverse_obj(data, ('youtube_url', {url_or_none})):
                    ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/err.py", line 197
    if format_url := traverse_obj(media_data, ('src', 'file', {url_or_none})):
                   ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/francetv.py", line 109
    if video := traverse_obj(dinfo, ('video', {dict})):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/godresource.py", line 53
    if (ext := determine_ext(video_url)) == 'm3u8':
            ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/jiosaavn.py", line 27
    if invalid_bitrates := set(requested_bitrates) - self._VALID_BITRATES:
                         ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/maariv.py", line 44
    if hls_url := traverse_obj(data, ('video', 'url', {url_or_none})):
                ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/newgrounds.py", line 141
    if errors := traverse_obj(result, ('errors', ..., {str})):
               ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/nfb.py", line 232
    if dv_source := url_or_none(player_data.get('dvSource')):
                  ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/nhk.py", line 421
    if value := clean_html(get_element_by_class(class_value, html)):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/niconico.py", line 400
    if fmt := self._extract_format_for_quality(video_id, audio_quality, video_quality, protocol):
            ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/nuum.py", line 23
    if error := response.get('error'):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/olympics.py", line 116
    if info := self._extract_from_nextjs_data(webpage, video_id):
             ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/patreon.py", line 299
    if post_tag := traverse_obj(include, ('attributes', 'value', {str})):
                 ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/peertube.py", line 1476
    if playlist_url := url_or_none(playlist.get('playlistUrl')):
                     ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/sharepoint.py", line 93
    if video_url := traverse_obj(video_data, ('downloadUrl', {url_or_none})):
                  ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/soundcloud.py", line 134
    if token := try_call(lambda: self._get_cookies(self._BASE_URL)['oauth_token'].value):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/sproutvideo.py", line 129
    if downloads := traverse_obj(data, ('downloads', {dict.items}, lambda _, v: url_or_none(v[1]))):
                  ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/tiktok.py", line 234
    if universal_data := self._get_universal_data(webpage, video_id):
                       ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/trtworld.py", line 88
    if youtube_id := traverse_obj(nuxtjs_data, ('youtube', 'metadata', 'youtubeId')):
                   ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/twitter.py", line 104
    if mobj := re.match(r'hls-[Aa]udio-(?P<bitrate>\d{4,})', f['format_id']):
             ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/vidyard.py", line 32
    if master_m3u8_url := traverse_obj(
                        ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/vimeo.py", line 885
    if target := error.cause.response.extensions.get('impersonate'):
               ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/youporn.py", line 250
    if video_url := traverse_obj(element, ({extract_attributes}, 'href', {lambda x: urljoin(url, x)})):
                  ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/extractor/youtube.py", line 3387
    if not (comment_id := traverse_obj(comment_entity_payload, ('properties', 'commentId', {str}))):
                       ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/networking/_requests.py", line 195
    if proxy := select_proxy(url, proxies):
              ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/update.py", line 74
    if static_exe_path := os.getenv('STATICX_PROG_PATH'):
                        ^
SyntaxError: invalid syntax

  File "/usr/lib/python3/dist-packages/yt_dlp/utils/_utils.py", line 5150
    def __init__(self, extension, /):
                                  ^
SyntaxError: invalid syntax

dpkg: error processing package yt-dlp (--configure):
 installed yt-dlp package post-installation script subprocess returned error exit status 1
Processing triggers for man-db (2.8.5-2+deb10u1) ...
Errors were encountered while processing:
 yt-dlp
E: Sub-process /usr/bin/dpkg returned an error code (1)

I installed yt-dlp update from Debian backports some days ago when I could not get clipgrab to work with the old version found in my repos for MX19.4. The Repo version is a year old. So none of the versions seem to work? I would also like to add that since this whole clipgrab not working/yt-dlp not working debackle, my MXPI backports repo also no longer works..

[MXRobo]

Just FYI, if you're not aware - MX-19 reached EOL a month or two ago.
Cheers!

[Stevo]

Since you must have installed the bookworm-backports yt-dlp, that's probably the root of your crashes. I would suggest uninstalling it, and then Clibgrab should download its own version for internal use instead; hopefully more compatible.

It's possible you may have to remove an older yt-dlp download in Clipgrab, if so, the "About:" dialog should show you where it is hiding.

[pianokeyjoe]

Since you must have installed the bookworm-backports yt-dlp, that's probably the root of your crashes. I would suggest uninstalling it, and then Clibgrab should download its own version for internal use instead; hopefully more compatible.

It's possible you may have to remove an older yt-dlp download in Clipgrab, if so, the "About:" dialog should show you where it is hiding.

Hi @Stevo thankyou for the suggestion. I am about to do just that but here is a screenshot of clipgrab about page and the error which seems to be python3 related for some reason.

[pianokeyjoe]

Just FYI, if you're not aware - MX-19 reached EOL a month or two ago.
Cheers!

Yes indeed @MXRobo I know this but I have had and used MX19 since 2019 and I have my whole world in this OS setup and not trying to wipe everything just to upgrade for the sake of one app. I did install MX 23 on a Dell tower that I mentioned to the forum a while back that was also having issues with yt-dlp and testing repo so even with the upgrade OS I had yt-dlp/gui etc woes. I suspect python 3 issues here but I could be wrong.

[Stevo]

Hmmm--the README on github states:

DEPENDENCIES
Python versions 3.8+ (CPython and PyPy) are supported. Other versions and implementations may or may not work correctly.

They have static Linux binaries there on Github that may work on older systems, but I don't know if Clipgrab can use them. I'd first download the file, make it executable if necessary, and then see if it works on the command line.

[Stevo]

The automatically downloaded yt-dlp Python 3 file would be in your home folder, in /.local/share/ClipGrab/ClipGrab/. This isn't visible to apt or any other applications. Possibly, if that doesn't work and the binary does, you could workaround with symlinks to the static version.

[Stevo]

The 33 meg amd64 binary is also a bit older:

Code: Select all

 yt-dlp --version
2023.12.30

[siamhie]

The automatically downloaded yt-dlp Python 3 file would be in your home folder, in /.local/share/ClipGrab/ClipGrab/. This isn't visible to apt or any other applications. Possibly, if that doesn't work and the binary does, you could workaround with symlinks to the static version.

I don't understand why clipgrab just doesn't use the systems installed version of yt-dlp.
I reinstalled MX-23.3 fluxbox over the weekend and when I opened clipgrab, it had a download/exit window.
I selected download but didn't see anything happen.
Checked the about screen and it shows yt-dlp 2024.08.06 installed even though I have 2024.08.01-1 installed.




I think I might look for another frontend for yt-dlp. (I have had issues in the past with clipgrab and YT).

[pianokeyjoe]

So I uninstalled the yt-dlp 08.06-01 that is an update to the august 1 version and still I get a python error on the clipgrab about page. I uninstalled clipgrab. There is no updated version compatible with MX19 and Debian Buster so I am stuck not downloading videos anymore on MX19.. Ah well, time to fire up my tower with MX23 lol.