pivccu-modules-dkms 1.0.37

Debian/Ubuntu basierte CCU

Moderator: Co-Administratoren

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 30.05.2020, 12:06

Hallo Alex

In den testing kernelmodules ist ein massiver Bug (Proxmox LXC).

Letzten Meldungen vom system waren circa:

Code: Alles auswählen

scheduling while atomic: swapper/6/0/0x00000100


Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) nfnetlink(E) binfmt_misc(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) aesni_intel(E) zunicode(POE) crypto_simd(E) zlua(POE) cryptd(E) zavl(POE) glue_helper(E) icp(POE) uvcvideo(E) intel_cstate(E) snd_usb_audio(E) snd_usbmidi_lib(E) videobuf2

Danach kamen ein haufen weitere Fehlermeldungen und das System ist komplett eingefroren

Kernel:
Linux server 5.4.41-1-pve #1 SMP PVE 5.4.41-1 (Fri, 15 May 2020 15:06:08 +0200) x86_64 GNU/Linux

Scheint aber egal zu sein.

mit stable 1.0.36 klappt wieder alles
Zuletzt geändert von quickmic am 30.05.2020, 12:24, insgesamt 1-mal geändert.

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 30.05.2020, 12:12

Code: Alles auswählen

May 30 11:05:39 server kernel: [   99.285127] eq3loop: created slave mmd_bidcos
May 30 11:05:49 server kernel: [  109.501198] eq3loop: eq3loop_open_slave() mmd_hmip
May 30 11:08:17 server kernel: [  256.601170] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [kvm:9715]
May 30 11:08:17 server kernel: [  256.601280] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
May 30 11:08:17 server kernel: [  256.601289] RAX: 0000000000000000 RBX: ffff9c8b5a140000 RCX: 0000000000000000
May 30 11:08:17 server kernel: [  256.601291] R13: 0000000000000000 R14: ffff9c8e48e91600 R15: 0000000000000000
May 30 11:08:17 server kernel: [  256.601306]  ? crash_vmclear_local_loaded_vmcss+0xe0/0xe0 [kvm_intel]
May 30 11:08:17 server kernel: [  256.601345]  ? __switch_to_asm+0x40/0x70
May 30 11:08:17 server kernel: [  256.601348]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.601352]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.601376]  finish_task_switch+0x15a/0x250
May 30 11:08:17 server kernel: [  256.601409]  kvm_vcpu_ioctl+0x24b/0x610 [kvm]
May 30 11:08:17 server kernel: [  256.601414]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.601419]  ksys_ioctl+0x67/0x90
May 30 11:08:17 server kernel: [  256.601426] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00$
May 30 11:08:17 server kernel: [  256.601429] R10: 0000000000000001 R11: 0000000000000246 R12: 00007f35433d9740
May 30 11:08:17 server kernel: [  256.613228] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT$
May 30 11:08:17 server kernel: [  256.613271] RIP: 0010:smp_call_function_single+0xe4/0x110
May 30 11:08:17 server kernel: [  256.613276] RBP: ffffb4448a9dbab8 R08: 0000000000000129 R09: 00000000000028c0
May 30 11:08:17 server kernel: [  256.613280] CR2: 00000008006790b3 CR3: 0000000ae466e001 CR4: 00000000000226e0
May 30 11:08:17 server kernel: [  256.613310]  vmx_vcpu_load+0x3b/0x190 [kvm_intel]
May 30 11:08:17 server kernel: [  256.613330]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.613335]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.613354]  kvm_arch_vcpu_load+0x6c/0x250 [kvm]
May 30 11:08:17 server kernel: [  256.613382]  kvm_vcpu_block+0x84/0x310 [kvm]
May 30 11:08:17 server kernel: [  256.613412]  ? __switch_to_asm+0x34/0x70
May 30 11:08:17 server kernel: [  256.613418]  do_vfs_ioctl+0xa9/0x640
May 30 11:08:17 server kernel: [  256.613425] RIP: 0033:0x7fc6bd648427
May 30 11:08:17 server kernel: [  256.613429] RBP: 0000000000000000 R08: 000055c149928350 R09: 00007fc4acffa1a0
May 30 11:08:25 server kernel: [  264.617045] watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [pvesr:14785]
May 30 11:08:25 server kernel: [  264.617162] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
May 30 11:08:25 server kernel: [  264.617171] RDX: 0000000000000000 RSI: ffffffffaea47e40 RDI: 0000000000000001
May 30 11:08:25 server kernel: [  264.617175] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 30 11:08:25 server kernel: [  264.617188]  arch_freq_prepare_all+0x67/0xa0
May 30 11:08:25 server kernel: [  264.617198]  vfs_open+0x2d/0x30
May 30 11:08:25 server kernel: [  264.617208]  do_sys_open+0x177/0x280



Benutzeravatar
deimos
Beiträge: 5396
Registriert: 20.06.2017, 10:38
System: Alternative CCU (auf Basis OCCU)
Wohnort: Leimersheim
Hat sich bedankt: 121 Mal
Danksagung erhalten: 957 Mal
Kontaktdaten:

Re: pivccu-modules-dkms 1.0.37

Beitrag von deimos » 30.05.2020, 13:21

Hi,

welche Funkhardware nutzt du? In der Version gab es minimale Änderungen am Treiber für die HB-RF-USB und den neuen Treiber für die HB-RF-USB-2. Sofern man diese Hatdware nicht nutzt, sind da absolut keine Änderungen vorhanden.
Welche Versionen der andere Pakete hattest du bei dem Test im Einsatz?

Viele Grüße
Alex

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 30.05.2020, 13:35

Ich verwende dein HB-RF-USB und noch Funk-Lan aber das kanns ja nicht sein.

Der Fehler ist uebrigends absolut reproduzierbar.
Im Moment fahre ich im container mit "testing", am Host jetzt mit "stable".
Das funktioniert soweit.

Ich müsste uebrigends noch genauer schauen aber mir ist vorgekommen, dass die Kernelmodule am Host ansich noch kein Problem machen beim Laden.
Nur wenn man den Container mit Debmatic startet und die Initialisierung der USB HW durch ist, gibts einen crash am Host und besagte Fehlermeldungen.
Das ist aber NICHT verifiziert, ich will den Host nicht zu sehr quälen mit Resets.

Vielleicht auch ein Problem beim Zusammenspiel? Neue Kernelmodule am Host und stable im Container hab ich nicht getestet.

Benutzeravatar
deimos
Beiträge: 5396
Registriert: 20.06.2017, 10:38
System: Alternative CCU (auf Basis OCCU)
Wohnort: Leimersheim
Hat sich bedankt: 121 Mal
Danksagung erhalten: 957 Mal
Kontaktdaten:

Re: pivccu-modules-dkms 1.0.37

Beitrag von deimos » 31.05.2020, 07:06

Hi,

ich habe das bei mir jetzt nochmal durchgetestet und konnte absolut keine Probleme feststellen. Im Host testing und im Container testing.

Was ich aber grade nicht testen konnte, was ich mir noch als potentielles Problem vorstellen könnte: Ich habe vor dem Update des Hosts den Container runtergefahren, dann das Update gemacht und dann den Host komplett neu gestartet. Ein Test, was passiert, wenn man den Neustart nicht macht, habe ich nicht durchgeführt. Was war hier dein Vorgehen?

Viele Grüße
Alex

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 31.05.2020, 09:34

Nun Container lief meistens beim Update des Hosts, aber nicht immer. Sollten beide Varianten abgedeckt sein.
Ich werde ein komplettes Image vom Proxmox als Backup ziehen, und dann nochmal testen...

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 31.05.2020, 12:35

Hab jetzt etwas weiter getestet.

Der Fehler tritt erst auf, wenn man den Container startet.

Das Problem ist diese Fehlermeldung, hier beginnen die Probleme:

[ 240.532512] BUG: scheduling while atomic: swapper/5/0/0x00000100


Komplettes Log bis zum abschmieren:

Code: Alles auswählen

[  161.500513] eq3loop: created slave mmd_hmip
[  161.500685] eq3loop: created slave mmd_bidcos
[  163.547325] eq3loop: eq3loop_open_slave() mmd_bidcos
[  171.433370] eq3loop: eq3loop_open_slave() mmd_hmip
[  171.433418] eq3loop: eq3loop_close_slave() mmd_hmip
[  171.434136] eq3loop: eq3loop_open_slave() mmd_hmip
[  171.434169] eq3loop: eq3loop_close_slave() mmd_hmip
[  171.435718] eq3loop: eq3loop_open_slave() mmd_hmip
[  224.033628] perf: interrupt took too long (2504 > 2500), lowering kernel.perf_event_max_sample_rate to 79750





[  240.532512] BUG: scheduling while atomic: swapper/5/0/0x00000100










[  240.532576] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  240.532599]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  240.532619] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P          IOE     5.4.41-1-pve #1
[  240.532619] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.532620] Call Trace:
[  240.532622]  <IRQ>
[  240.532628]  dump_stack+0x6d/0x9a
[  240.532631]  __schedule_bug.cold.91+0x4c/0x5d
[  240.532634]  __schedule+0x5a9/0x6f0
[  240.532635]  schedule+0x33/0xa0
[  240.532636]  schedule_timeout+0x152/0x300
[  240.532640]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.532642]  ? __next_timer_interrupt+0xd0/0xd0
[  240.532644]  wait_for_completion_timeout+0xac/0x140
[  240.532645]  ? wake_up_q+0x80/0x80
[  240.532646]  usb_start_wait_urb+0xe3/0x180
[  240.532647]  usb_control_msg+0xdc/0x140
[  240.532650]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.532652]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.532655]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.532657]  ? led_set_brightness_nosleep+0x30/0x30
[  240.532658]  gpiod_set_raw_value+0x46/0x50
[  240.532660]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.532661]  led_set_brightness_nopm+0x17/0x40
[  240.532663]  led_timer_function+0x57/0xe0
[  240.532664]  call_timer_fn+0x32/0x130
[  240.532665]  run_timer_softirq+0x1a5/0x430
[  240.532667]  __do_softirq+0xdc/0x2d4
[  240.532670]  irq_exit+0xa9/0xb0
[  240.532671]  smp_apic_timer_interrupt+0x79/0x130
[  240.532672]  apic_timer_interrupt+0xf/0x20
[  240.532672]  </IRQ>
[  240.532674] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.532676] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.532676] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.532678] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.532678] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.532679] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.532679] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.532680] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.532681]  ? cpuidle_enter_state+0x99/0x450
[  240.532682]  cpuidle_enter+0x2e/0x40
[  240.532684]  call_cpuidle+0x23/0x40
[  240.532685]  do_idle+0x22c/0x270
[  240.532686]  cpu_startup_entry+0x1d/0x20
[  240.532688]  start_secondary+0x166/0x1c0
[  240.532691]  secondary_startup_64+0xa4/0xb0
[  240.532692] bad: scheduling from the idle thread!
[  240.532747] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P        W IOE     5.4.41-1-pve #1
[  240.532747] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.532748] Call Trace:
[  240.532748]  <IRQ>
[  240.532749]  dump_stack+0x6d/0x9a
[  240.532750]  dequeue_task_idle+0x2c/0x40
[  240.532751]  dequeue_task+0xd7/0x2e0
[  240.532755]  ? sched_clock+0x9/0x10
[  240.532756]  deactivate_task+0x3a/0x40
[  240.532757]  __schedule+0x119/0x6f0
[  240.532758]  schedule+0x33/0xa0
[  240.532759]  schedule_timeout+0x152/0x300
[  240.532760]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.532761]  ? __next_timer_interrupt+0xd0/0xd0
[  240.532763]  wait_for_completion_timeout+0xac/0x140
[  240.532764]  ? wake_up_q+0x80/0x80
[  240.532765]  usb_start_wait_urb+0xe3/0x180
[  240.532766]  usb_control_msg+0xdc/0x140
[  240.532767]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.532768]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.532770]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.532771]  ? led_set_brightness_nosleep+0x30/0x30
[  240.532772]  gpiod_set_raw_value+0x46/0x50
[  240.532773]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.532774]  led_set_brightness_nopm+0x17/0x40
[  240.532775]  led_timer_function+0x57/0xe0
[  240.532776]  call_timer_fn+0x32/0x130
[  240.532778]  run_timer_softirq+0x1a5/0x430
[  240.532779]  __do_softirq+0xdc/0x2d4
[  240.532780]  irq_exit+0xa9/0xb0
[  240.532781]  smp_apic_timer_interrupt+0x79/0x130
[  240.532782]  apic_timer_interrupt+0xf/0x20
[  240.532783]  </IRQ>
[  240.532784] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.532785] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.532785] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.532786] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.532787] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.532787] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.532788] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.532789] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.532790]  ? cpuidle_enter_state+0x99/0x450
[  240.532791]  cpuidle_enter+0x2e/0x40
[  240.532792]  call_cpuidle+0x23/0x40
[  240.532793]  do_idle+0x22c/0x270
[  240.532795]  cpu_startup_entry+0x1d/0x20
[  240.532796]  start_secondary+0x166/0x1c0
[  240.532797]  secondary_startup_64+0xa4/0xb0
[  240.532799] bad: scheduling from the idle thread!
[  240.532857] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P        W IOE     5.4.41-1-pve #1
[  240.532857] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.532857] Call Trace:
[  240.532858]  <IRQ>
[  240.532859]  dump_stack+0x6d/0x9a
[  240.532860]  dequeue_task_idle+0x2c/0x40
[  240.532861]  dequeue_task+0xd7/0x2e0
[  240.532862]  ? sched_clock+0x9/0x10
[  240.532863]  deactivate_task+0x3a/0x40
[  240.532864]  __schedule+0x119/0x6f0
[  240.532865]  schedule+0x33/0xa0
[  240.532866]  schedule_timeout+0x152/0x300
[  240.532867]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.532868]  ? __next_timer_interrupt+0xd0/0xd0
[  240.532870]  wait_for_completion_timeout+0xac/0x140
[  240.532871]  ? wake_up_q+0x80/0x80
[  240.532872]  usb_start_wait_urb+0xe3/0x180
[  240.532873]  usb_control_msg+0xdc/0x140
[  240.532874]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.532876]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.532877]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.532878]  ? led_set_brightness_nosleep+0x30/0x30
[  240.532879]  gpiod_set_raw_value+0x46/0x50
[  240.532880]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.532882]  led_set_brightness_nopm+0x17/0x40
[  240.532883]  led_timer_function+0x57/0xe0
[  240.532884]  call_timer_fn+0x32/0x130
[  240.532885]  run_timer_softirq+0x1a5/0x430
[  240.532886]  __do_softirq+0xdc/0x2d4
[  240.532887]  irq_exit+0xa9/0xb0
[  240.532889]  smp_apic_timer_interrupt+0x79/0x130
[  240.532890]  apic_timer_interrupt+0xf/0x20
[  240.532890]  </IRQ>
[  240.532891] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.532892] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.532892] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.532893] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.532894] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.532894] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.532895] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.532896] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.532897]  ? cpuidle_enter_state+0x99/0x450
[  240.532898]  cpuidle_enter+0x2e/0x40
[  240.532899]  call_cpuidle+0x23/0x40
[  240.532900]  do_idle+0x22c/0x270
[  240.532902]  cpu_startup_entry+0x1d/0x20
[  240.532902]  start_secondary+0x166/0x1c0
[  240.532904]  secondary_startup_64+0xa4/0xb0
[  240.532905] bad: scheduling from the idle thread!
[  240.532961] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P        W IOE     5.4.41-1-pve #1
[  240.532961] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.532961] Call Trace:
[  240.532962]  <IRQ>
[  240.532963]  dump_stack+0x6d/0x9a
[  240.532964]  dequeue_task_idle+0x2c/0x40
[  240.532965]  dequeue_task+0xd7/0x2e0
[  240.532966]  ? sched_clock+0x9/0x10
[  240.532967]  deactivate_task+0x3a/0x40
[  240.532968]  __schedule+0x119/0x6f0
[  240.532970]  schedule+0x33/0xa0
[  240.532970]  schedule_timeout+0x152/0x300
[  240.532972]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.532973]  ? __next_timer_interrupt+0xd0/0xd0
[  240.532974]  wait_for_completion_timeout+0xac/0x140
[  240.532975]  ? wake_up_q+0x80/0x80
[  240.532976]  usb_start_wait_urb+0xe3/0x180
[  240.532977]  usb_control_msg+0xdc/0x140
[  240.532979]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.532980]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.532981]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.532982]  ? led_set_brightness_nosleep+0x30/0x30
[  240.532983]  gpiod_set_raw_value+0x46/0x50
[  240.532985]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.532986]  led_set_brightness_nopm+0x17/0x40
[  240.532987]  led_timer_function+0x57/0xe0
[  240.532988]  call_timer_fn+0x32/0x130
[  240.532989]  run_timer_softirq+0x1a5/0x430
[  240.532990]  __do_softirq+0xdc/0x2d4
[  240.532992]  irq_exit+0xa9/0xb0
[  240.532993]  smp_apic_timer_interrupt+0x79/0x130
[  240.532994]  apic_timer_interrupt+0xf/0x20
[  240.532994]  </IRQ>
[  240.532995] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.532996] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.532996] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.532997] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.532998] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.532999] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.532999] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.533000] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.533001]  ? cpuidle_enter_state+0x99/0x450
[  240.533002]  cpuidle_enter+0x2e/0x40
[  240.533003]  call_cpuidle+0x23/0x40
[  240.533004]  do_idle+0x22c/0x270
[  240.533006]  cpu_startup_entry+0x1d/0x20
[  240.533007]  start_secondary+0x166/0x1c0
[  240.533008]  secondary_startup_64+0xa4/0xb0
[  240.533009] bad: scheduling from the idle thread!
[  240.533065] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P        W IOE     5.4.41-1-pve #1
[  240.533065] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.533065] Call Trace:
[  240.533066]  <IRQ>
[  240.533067]  dump_stack+0x6d/0x9a
[  240.533068]  dequeue_task_idle+0x2c/0x40
[  240.533069]  dequeue_task+0xd7/0x2e0
[  240.533070]  ? sched_clock+0x9/0x10
[  240.533071]  deactivate_task+0x3a/0x40
[  240.533072]  __schedule+0x119/0x6f0
[  240.533073]  schedule+0x33/0xa0
[  240.533074]  schedule_timeout+0x152/0x300
[  240.533075]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.533076]  ? __next_timer_interrupt+0xd0/0xd0
[  240.533078]  wait_for_completion_timeout+0xac/0x140
[  240.533079]  ? wake_up_q+0x80/0x80
[  240.533080]  usb_start_wait_urb+0xe3/0x180
[  240.533081]  usb_control_msg+0xdc/0x140
[  240.533082]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.533084]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.533085]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.533086]  ? led_set_brightness_nosleep+0x30/0x30
[  240.533087]  gpiod_set_raw_value+0x46/0x50
[  240.533088]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.533090]  led_set_brightness_nopm+0x17/0x40
[  240.533091]  led_timer_function+0x57/0xe0
[  240.533092]  call_timer_fn+0x32/0x130
[  240.533093]  run_timer_softirq+0x1a5/0x430
[  240.533094]  __do_softirq+0xdc/0x2d4
[  240.533095]  irq_exit+0xa9/0xb0
[  240.533096]  smp_apic_timer_interrupt+0x79/0x130
[  240.533098]  apic_timer_interrupt+0xf/0x20
[  240.533098]  </IRQ>
[  240.533099] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.533100] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.533100] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.533101] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.533102] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.533102] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.533103] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.533103] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.533105]  ? cpuidle_enter_state+0x99/0x450
[  240.533106]  cpuidle_enter+0x2e/0x40
[  240.533107]  call_cpuidle+0x23/0x40
[  240.533108]  do_idle+0x22c/0x270
[  240.533110]  cpu_startup_entry+0x1d/0x20
[  240.533110]  start_secondary+0x166/0x1c0
[  240.533111]  secondary_startup_64+0xa4/0xb0
[  240.533113] bad: scheduling from the idle thread!
[  240.533169] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P        W IOE     5.4.41-1-pve #1
[  240.533169] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  240.533170] Call Trace:
[  240.533170]  <IRQ>
[  240.533171]  dump_stack+0x6d/0x9a
[  240.533173]  dequeue_task_idle+0x2c/0x40
[  240.533174]  dequeue_task+0xd7/0x2e0
[  240.533176]  ? sched_clock+0x9/0x10
[  240.533177]  deactivate_task+0x3a/0x40
[  240.533179]  __schedule+0x119/0x6f0
[  240.533180]  schedule+0x33/0xa0
[  240.533182]  schedule_timeout+0x152/0x300
[  240.533183]  ? usb_hcd_giveback_urb+0xca/0xe0
[  240.533184]  ? __next_timer_interrupt+0xd0/0xd0
[  240.533186]  wait_for_completion_timeout+0xac/0x140
[  240.533188]  ? wake_up_q+0x80/0x80
[  240.533189]  usb_start_wait_urb+0xe3/0x180
[  240.533190]  usb_control_msg+0xdc/0x140
[  240.533192]  hb_rf_usb_set_bitmode+0x5d/0x80 [hb_rf_usb]
[  240.533194]  hb_rf_usb_gpio_set+0x62/0x90 [hb_rf_usb]
[  240.533196]  gpiod_set_raw_value_commit+0x45/0xb0
[  240.533197]  ? led_set_brightness_nosleep+0x30/0x30
[  240.533199]  gpiod_set_raw_value+0x46/0x50
[  240.533200]  rpi_rf_mod_led_set_led_brightness+0x32/0x40 [rpi_rf_mod_led]
[  240.533202]  led_set_brightness_nopm+0x17/0x40
[  240.533203]  led_timer_function+0x57/0xe0
[  240.533205]  call_timer_fn+0x32/0x130
[  240.533206]  run_timer_softirq+0x1a5/0x430
[  240.533208]  __do_softirq+0xdc/0x2d4
[  240.533210]  irq_exit+0xa9/0xb0
[  240.533211]  smp_apic_timer_interrupt+0x79/0x130
[  240.533212]  apic_timer_interrupt+0xf/0x20
[  240.533213]  </IRQ>
[  240.533214] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  240.533215] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  240.533216] RSP: 0018:ffff9e81c00abe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  240.533217] RAX: ffff91becf96ad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  240.533218] RDX: 0000003800da4a1e RSI: 0000000024d6e008 RDI: 0000000000000000
[  240.533219] RBP: ffff9e81c00abe88 R08: 0000000000000002 R09: 000000000002a5c0
[  240.533220] R10: 00000113a7d5a394 R11: ffff91becf9699e0 R12: ffff91becf975f00
[  240.533221] R13: 0000000000000003 R14: ffffffffa3157b38 R15: ffffffffa3157b20
[  240.533222]  ? cpuidle_enter_state+0x99/0x450
[  240.533224]  cpuidle_enter+0x2e/0x40
[  240.533225]  call_cpuidle+0x23/0x40
[  240.533227]  do_idle+0x22c/0x270
[  240.533228]  cpu_startup_entry+0x1d/0x20
[  240.533230]  start_secondary+0x166/0x1c0
[  240.533231]  secondary_startup_64+0xa4/0xb0
[  250.540327] xhci_hcd 0000:05:00.0: xHCI host not responding to stop endpoint command.
[  250.540334] xhci_hcd 0000:05:00.0: xHCI host controller not responding, assume dead
[  250.540422] xhci_hcd 0000:05:00.0: xHCI host not responding to stop endpoint command.
[  250.540480] xhci_hcd 0000:05:00.0: HC died; cleaning up
[  250.540491] usb 3-3.4: Not enough bandwidth for altsetting 0
[  250.540576] usb 3-1: Not enough bandwidth for altsetting 0
[  250.540692] usb 3-1: USB disconnect, device number 2
[  250.540756] usb 5-3: USB disconnect, device number 2
[  257.448256] ------------[ cut here ]------------
[  257.448260] NETDEV WATCHDOG: eth2 (r8169): transmit queue 0 timed out
[  257.448288] WARNING: CPU: 6 PID: 0 at net/sched/sch_generic.c:448 dev_watchdog+0x264/0x270
[  257.448289] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  257.448317]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  257.448341] CPU: 6 PID: 0 Comm: swapper/6 Tainted: P        W IOE     5.4.41-1-pve #1
[  257.448342] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  257.448345] RIP: 0010:dev_watchdog+0x264/0x270
[  257.448347] Code: 48 85 c0 75 e6 eb a0 4c 89 ef c6 05 82 1a eb 00 01 e8 80 b1 fa ff 89 d9 4c 89 ee 48 c7 c7 80 31 e3 a2 48 89 c2 e8 fd 7a 74 ff <0f> 0b eb 82 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 41
[  257.448348] RSP: 0018:ffff9e81c023ce58 EFLAGS: 00010282
[  257.448349] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000006
[  257.448349] RDX: 0000000000000007 RSI: 0000000000000082 RDI: ffff91becf9978c0
[  257.448350] RBP: ffff9e81c023ce88 R08: 000000000000060d R09: 0000000000000004
[  257.448350] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
[  257.448351] R13: ffff91bec894e000 R14: ffff91bec894e480 R15: ffff91bec8354e80
[  257.448352] FS:  0000000000000000(0000) GS:ffff91becf980000(0000) knlGS:0000000000000000
[  257.448352] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  257.448353] CR2: 00005604e67e70d4 CR3: 000000050a80a005 CR4: 00000000000226e0
[  257.448354] Call Trace:
[  257.448355]  <IRQ>
[  257.448359]  ? pfifo_fast_enqueue+0x160/0x160
[  257.448361]  call_timer_fn+0x32/0x130
[  257.448362]  run_timer_softirq+0x1a5/0x430
[  257.448364]  ? enqueue_hrtimer+0x3c/0x90
[  257.448366]  ? ktime_get+0x3c/0xa0
[  257.448368]  ? lapic_next_event+0x20/0x30
[  257.448370]  ? clockevents_program_event+0x93/0xf0
[  257.448373]  __do_softirq+0xdc/0x2d4
[  257.448375]  irq_exit+0xa9/0xb0
[  257.448376]  smp_apic_timer_interrupt+0x79/0x130
[  257.448378]  apic_timer_interrupt+0xf/0x20
[  257.448378]  </IRQ>
[  257.448380] RIP: 0010:cpuidle_enter_state+0xba/0x450
[  257.448381] Code: 66 90 31 ff e8 67 b2 84 ff 80 7d c7 00 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 63 03 00 00 31 ff e8 ea 1f 8b ff fb 66 66 90 <66> 66 90 45 85 ed 0f 88 8d 02 00 00 49 63 cd 48 8b 75 d0 48 2b 75
[  257.448381] RSP: 0018:ffff9e81c00b3e48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[  257.448382] RAX: ffff91becf9aad40 RBX: ffffffffa3157a00 RCX: 000000000000001f
[  257.448383] RDX: 0000003bf11c80f1 RSI: 0000000024d6e008 RDI: 0000000000000000
[  257.448383] RBP: ffff9e81c00b3e88 R08: 0000000000000002 R09: 000000000002a5c0
[  257.448384] R10: 0000012157131759 R11: ffff91becf9a99e0 R12: ffff91becf9b5f00
[  257.448384] R13: 0000000000000004 R14: ffffffffa3157b98 R15: ffffffffa3157b80
[  257.448386]  ? cpuidle_enter_state+0x99/0x450
[  257.448387]  cpuidle_enter+0x2e/0x40
[  257.448389]  call_cpuidle+0x23/0x40
[  257.448390]  do_idle+0x22c/0x270
[  257.448392]  cpu_startup_entry+0x1d/0x20
[  257.448393]  start_secondary+0x166/0x1c0
[  257.448395]  secondary_startup_64+0xa4/0xb0
[  257.448397] ---[ end trace c0403cb3041d204e ]---
[  264.604103] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kvm:6128]
[  264.604167] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  264.604199]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  264.604226] CPU: 2 PID: 6128 Comm: kvm Tainted: P        W IOE     5.4.41-1-pve #1
[  264.604226] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  264.604232] RIP: 0010:smp_call_function_single+0xe8/0x110
[  264.604234] Code: 65 48 33 0c 25 28 00 00 00 75 42 c9 c3 48 89 d1 48 89 f2 48 89 e6 e8 57 fe ff ff 8b 54 24 18 83 e2 01 74 0b f3 90 8b 54 24 18 <83> e2 01 75 f5 eb ca 8b 05 2b b1 a3 01 85 c0 0f 85 72 ff ff ff 0f
[  264.604235] RSP: 0018:ffff9e81ca823a60 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[  264.604236] RAX: 0000000000000000 RBX: ffff91bc4e410000 RCX: ffff9e81ca923a60
[  264.604237] RDX: 0000000000000003 RSI: ffff9e81ca823a60 RDI: ffff9e81ca823a60
[  264.604238] RBP: ffff9e81ca823ab8 R08: 0000000000000182 R09: 0000000000001f82
[  264.604238] R10: 0000000000001f82 R11: ffff91becf8a99e0 R12: 0000000000000002
[  264.604239] R13: 000000000000000b R14: ffff91bec8c39600 R15: 0000000000000000
[  264.604240] FS:  00007f56ab5ff700(0000) GS:ffff91becf880000(0000) knlGS:0000000000000000
[  264.604241] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  264.604242] CR2: 000000080066bb84 CR3: 0000000990b24006 CR4: 00000000000226e0
[  264.604243] Call Trace:
[  264.604255]  ? crash_vmclear_local_loaded_vmcss+0xe0/0xe0 [kvm_intel]
[  264.604287]  ? restart_apic_timer+0xa0/0x190 [kvm]
[  264.604291]  vmx_vcpu_load_vmcs+0x15e/0x450 [kvm_intel]
[  264.604295]  vmx_vcpu_load+0x3b/0x190 [kvm_intel]
[  264.604312]  ? kvm_x2apic_msr_write+0x54/0x80 [kvm]
[  264.604316]  ? __switch_to_asm+0x40/0x70
[  264.604317]  ? __switch_to_asm+0x34/0x70
[  264.604319]  ? __switch_to_asm+0x40/0x70
[  264.604320]  ? __switch_to_asm+0x34/0x70
[  264.604321]  ? __switch_to_asm+0x40/0x70
[  264.604322]  ? __switch_to_asm+0x34/0x70
[  264.604323]  ? __switch_to_asm+0x34/0x70
[  264.604324]  ? __switch_to_asm+0x40/0x70
[  264.604325]  ? __switch_to_asm+0x34/0x70
[  264.604326]  ? __switch_to_asm+0x40/0x70
[  264.604327]  ? __switch_to_asm+0x34/0x70
[  264.604328]  ? __switch_to_asm+0x40/0x70
[  264.604329]  ? __switch_to_asm+0x34/0x70
[  264.604348]  kvm_arch_vcpu_load+0x6c/0x250 [kvm]
[  264.604364]  kvm_sched_in+0x34/0x40 [kvm]
[  264.604367]  finish_task_switch+0x15a/0x250
[  264.604370]  __schedule+0x2ee/0x6f0
[  264.604372]  schedule+0x33/0xa0
[  264.604388]  kvm_vcpu_block+0x84/0x310 [kvm]
[  264.604406]  kvm_arch_vcpu_ioctl_run+0x311/0x570 [kvm]
[  264.604421]  kvm_vcpu_ioctl+0x24b/0x610 [kvm]
[  264.604424]  ? do_futex+0xc7/0xc50
[  264.604426]  ? __switch_to_asm+0x40/0x70
[  264.604427]  ? __switch_to_asm+0x34/0x70
[  264.604428]  ? __switch_to_asm+0x40/0x70
[  264.604429]  ? __switch_to_asm+0x34/0x70
[  264.604430]  ? __switch_to_asm+0x40/0x70
[  264.604431]  ? __switch_to_asm+0x40/0x70
[  264.604434]  do_vfs_ioctl+0xa9/0x640
[  264.604436]  ksys_ioctl+0x67/0x90
[  264.604437]  __x64_sys_ioctl+0x1a/0x20
[  264.604441]  do_syscall_64+0x57/0x190
[  264.604442]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  264.604444] RIP: 0033:0x7f58badd9427
[  264.604445] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[  264.604446] RSP: 002b:00007f56ab5fa3b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  264.604448] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007f58badd9427
[  264.604449] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 000000000000001e
[  264.604449] RBP: 0000000000000000 R08: 000055c141090350 R09: 00007f56ab5fa1a0
[  264.604450] R10: 0000000000000001 R11: 0000000000000246 R12: 00007f56abdd2b80
[  264.604451] R13: 000055c14105a2e0 R14: 00007f58ae387000 R15: 0000000000000000
[  264.612102] watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kvm:6131]
[  264.612163] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  264.612183]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  264.612200] CPU: 4 PID: 6131 Comm: kvm Tainted: P        W IOEL    5.4.41-1-pve #1
[  264.612201] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  264.612205] RIP: 0010:smp_call_function_single+0xe8/0x110
[  264.612206] Code: 65 48 33 0c 25 28 00 00 00 75 42 c9 c3 48 89 d1 48 89 f2 48 89 e6 e8 57 fe ff ff 8b 54 24 18 83 e2 01 74 0b f3 90 8b 54 24 18 <83> e2 01 75 f5 eb ca 8b 05 2b b1 a3 01 85 c0 0f 85 72 ff ff ff 0f
[  264.612207] RSP: 0018:ffff9e81ca923a60 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[  264.612208] RAX: 0000000000000000 RBX: ffff91bc39b98000 RCX: 0000000000000000
[  264.612209] RDX: 0000000000000003 RSI: 00000000000000fb RDI: 0000000000000202
[  264.612209] RBP: ffff9e81ca923ab8 R08: 000000000002a670 R09: 0000000000000001
[  264.612210] R10: 0000000000001f82 R11: ffff91becf9299e0 R12: 0000000000000004
[  264.612210] R13: 000000000000000b R14: ffff91bec8e94200 R15: 0000000000000000
[  264.612211] FS:  00007f56a99ff700(0000) GS:ffff91becf900000(0000) knlGS:0000000000000000
[  264.612212] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  264.612212] CR2: 000000000022a1f4 CR3: 0000000990b24001 CR4: 00000000000226e0
[  264.612213] Call Trace:
[  264.612221]  ? crash_vmclear_local_loaded_vmcss+0xe0/0xe0 [kvm_intel]
[  264.612240]  ? restart_apic_timer+0xa0/0x190 [kvm]
[  264.612243]  vmx_vcpu_load_vmcs+0x15e/0x450 [kvm_intel]
[  264.612246]  vmx_vcpu_load+0x3b/0x190 [kvm_intel]
[  264.612258]  ? kvm_x2apic_msr_write+0x54/0x80 [kvm]
[  264.612262]  ? __switch_to_asm+0x40/0x70
[  264.612264]  ? __switch_to_asm+0x34/0x70
[  264.612265]  ? __switch_to_asm+0x40/0x70
[  264.612266]  ? __switch_to_asm+0x34/0x70
[  264.612266]  ? __switch_to_asm+0x40/0x70
[  264.612267]  ? __switch_to_asm+0x34/0x70
[  264.612269]  ? __switch_to_asm+0x34/0x70
[  264.612270]  ? __switch_to_asm+0x40/0x70
[  264.612271]  ? __switch_to_asm+0x34/0x70
[  264.612272]  ? __switch_to_asm+0x40/0x70
[  264.612272]  ? __switch_to_asm+0x34/0x70
[  264.612273]  ? __switch_to_asm+0x40/0x70
[  264.612275]  ? __switch_to_asm+0x34/0x70
[  264.612289]  kvm_arch_vcpu_load+0x6c/0x250 [kvm]
[  264.612299]  kvm_sched_in+0x34/0x40 [kvm]
[  264.612300]  finish_task_switch+0x15a/0x250
[  264.612302]  __schedule+0x2ee/0x6f0
[  264.612303]  schedule+0x33/0xa0
[  264.612312]  kvm_vcpu_block+0x84/0x310 [kvm]
[  264.612324]  kvm_arch_vcpu_ioctl_run+0x311/0x570 [kvm]
[  264.612333]  kvm_vcpu_ioctl+0x24b/0x610 [kvm]
[  264.612335]  ? do_futex+0xc7/0xc50
[  264.612335]  ? __switch_to_asm+0x40/0x70
[  264.612336]  ? __switch_to_asm+0x34/0x70
[  264.612337]  ? __switch_to_asm+0x40/0x70
[  264.612338]  ? __switch_to_asm+0x34/0x70
[  264.612339]  ? apic_timer_interrupt+0xa/0x20
[  264.612340]  do_vfs_ioctl+0xa9/0x640
[  264.612341]  ksys_ioctl+0x67/0x90
[  264.612342]  __x64_sys_ioctl+0x1a/0x20
[  264.612344]  do_syscall_64+0x57/0x190
[  264.612345]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  264.612346] RIP: 0033:0x7f58badd9427
[  264.612348] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[  264.612348] RSP: 002b:00007f56a99fa3b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  264.612349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007f58badd9427
[  264.612350] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000020
[  264.612351] RBP: 0000000000000000 R08: 000055c141090350 R09: 00007f56a99fa1a0
[  264.612351] R10: 0000000000000001 R11: 0000000000000246 R12: 00007f56abe367c0
[  264.612352] R13: 000055c14105a2e0 R14: 00007f58ae381000 R15: 0000000000000000
[  292.603670] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kvm:6128]
[  292.603733] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  292.603760]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  292.603781] CPU: 2 PID: 6128 Comm: kvm Tainted: P        W IOEL    5.4.41-1-pve #1
[  292.603782] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  292.603787] RIP: 0010:smp_call_function_single+0xe4/0x110
[  292.603789] Code: 8b 4c 24 38 65 48 33 0c 25 28 00 00 00 75 42 c9 c3 48 89 d1 48 89 f2 48 89 e6 e8 57 fe ff ff 8b 54 24 18 83 e2 01 74 0b f3 90 <8b> 54 24 18 83 e2 01 75 f5 eb ca 8b 05 2b b1 a3 01 85 c0 0f 85 72
[  292.603789] RSP: 0018:ffff9e81ca823a60 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[  292.603790] RAX: 0000000000000000 RBX: ffff91bc4e410000 RCX: ffff9e81ca923a60
[  292.603791] RDX: 0000000000000001 RSI: ffff9e81ca823a60 RDI: ffff9e81ca823a60
[  292.603792] RBP: ffff9e81ca823ab8 R08: 0000000000000182 R09: 0000000000001f82
[  292.603792] R10: 0000000000001f82 R11: ffff91becf8a99e0 R12: 0000000000000002
[  292.603793] R13: 000000000000000b R14: ffff91bec8c39600 R15: 0000000000000000
[  292.603793] FS:  00007f56ab5ff700(0000) GS:ffff91becf880000(0000) knlGS:0000000000000000
[  292.603794] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  292.603795] CR2: 000000080066bb84 CR3: 0000000990b24006 CR4: 00000000000226e0
[  292.603795] Call Trace:
[  292.603805]  ? crash_vmclear_local_loaded_vmcss+0xe0/0xe0 [kvm_intel]
[  292.603833]  ? restart_apic_timer+0xa0/0x190 [kvm]
[  292.603836]  vmx_vcpu_load_vmcs+0x15e/0x450 [kvm_intel]
[  292.603840]  vmx_vcpu_load+0x3b/0x190 [kvm_intel]
[  292.603851]  ? kvm_x2apic_msr_write+0x54/0x80 [kvm]
[  292.603854]  ? __switch_to_asm+0x40/0x70
[  292.603855]  ? __switch_to_asm+0x34/0x70
[  292.603856]  ? __switch_to_asm+0x40/0x70
[  292.603856]  ? __switch_to_asm+0x34/0x70
[  292.603857]  ? __switch_to_asm+0x40/0x70
[  292.603858]  ? __switch_to_asm+0x34/0x70
[  292.603859]  ? __switch_to_asm+0x34/0x70
[  292.603859]  ? __switch_to_asm+0x40/0x70
[  292.603860]  ? __switch_to_asm+0x34/0x70
[  292.603861]  ? __switch_to_asm+0x40/0x70
[  292.603862]  ? __switch_to_asm+0x34/0x70
[  292.603862]  ? __switch_to_asm+0x40/0x70
[  292.603863]  ? __switch_to_asm+0x34/0x70
[  292.603874]  kvm_arch_vcpu_load+0x6c/0x250 [kvm]
[  292.603883]  kvm_sched_in+0x34/0x40 [kvm]
[  292.603885]  finish_task_switch+0x15a/0x250
[  292.603887]  __schedule+0x2ee/0x6f0
[  292.603888]  schedule+0x33/0xa0
[  292.603900]  kvm_vcpu_block+0x84/0x310 [kvm]
[  292.603916]  kvm_arch_vcpu_ioctl_run+0x311/0x570 [kvm]
[  292.603926]  kvm_vcpu_ioctl+0x24b/0x610 [kvm]
[  292.603927]  ? do_futex+0xc7/0xc50
[  292.603928]  ? __switch_to_asm+0x40/0x70
[  292.603929]  ? __switch_to_asm+0x34/0x70
[  292.603930]  ? __switch_to_asm+0x40/0x70
[  292.603930]  ? __switch_to_asm+0x34/0x70
[  292.603931]  ? __switch_to_asm+0x40/0x70
[  292.603932]  ? __switch_to_asm+0x40/0x70
[  292.603934]  do_vfs_ioctl+0xa9/0x640
[  292.603935]  ksys_ioctl+0x67/0x90
[  292.603936]  __x64_sys_ioctl+0x1a/0x20
[  292.603938]  do_syscall_64+0x57/0x190
[  292.603939]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  292.603941] RIP: 0033:0x7f58badd9427
[  292.603942] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[  292.603943] RSP: 002b:00007f56ab5fa3b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  292.603944] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007f58badd9427
[  292.603944] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 000000000000001e
[  292.603945] RBP: 0000000000000000 R08: 000055c141090350 R09: 00007f56ab5fa1a0
[  292.603945] R10: 0000000000000001 R11: 0000000000000246 R12: 00007f56abdd2b80
[  292.603946] R13: 000055c14105a2e0 R14: 00007f58ae387000 R15: 0000000000000000
[  292.611668] watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kvm:6131]
[  292.611730] Modules linked in: dummy_rx8130(OE) ledtrig_timer(E) ledtrig_default_on(E) rpi_rf_mod_led(OE) eq3_char_loop(OE) ipt_REJECT(E) nf_reject_ipv4(E) xt_multiport(E) nft_compat(E) nft_counter(E) nf_tables(E) nfsd(E) auth_rpcgss(E) nfs_acl(E) lockd(E) grace(E) veth(E) ebtable_filter(E) ebtables(E) ip_set(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) bpfilter(E) bonding(E) openvswitch(E) nsh(E) nf_conncount(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) softdog(E) nfnetlink_log(E) binfmt_misc(E) nfnetlink(E) intel_powerclamp(E) kvm_intel(E) kvm(E) irqbypass(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) zfs(POE) zunicode(POE) aesni_intel(E) zlua(POE) crypto_simd(E) zavl(POE) cryptd(E) glue_helper(E) icp(POE) snd_usb_audio(E) uvcvideo(E) snd_usbmidi_lib(E) snd_hwdep(E) videobuf2_vmalloc(E) snd_rawmidi(E) videobuf2_memops(E) videobuf2_v4l2(E) snd_seq_device(E) intel_cstate(E) videobuf2_common(E)
[  292.611752]  snd_pcm(E) input_leds(E) snd_timer(E) videodev(E) snd(E) serio_raw(E) ftdi_sio(E) mc(E) soundcore(E) mxm_wmi(E) usbserial(E) hb_rf_usb(OE) generic_raw_uart(OE) i7core_edac(E) i5500_temp(E) asus_atk0110(E) mac_hid(E) zcommon(POE) znvpair(POE) spl(OE) vhost_net(E) vhost(E) tap(E) ib_iser(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) iscsi_tcp(E) libiscsi_tcp(E) libiscsi(E) scsi_transport_iscsi(E) cuse(E) coretemp(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) i2c_i801(E) ahci(E) xhci_pci(E) libahci(E) lpc_ich(E) r8169(E) xhci_hcd(E) realtek(E) uhci_hcd(E) ehci_pci(E) ehci_hcd(E) aacraid(E) e1000e(E) wmi(E)
[  292.611769] CPU: 4 PID: 6131 Comm: kvm Tainted: P        W IOEL    5.4.41-1-pve #1
[  292.611770] Hardware name: System manufacturer System Product Name/P6T, BIOS 1408    09/21/2010
[  292.611774] RIP: 0010:smp_call_function_single+0xe4/0x110
[  292.611776] Code: 8b 4c 24 38 65 48 33 0c 25 28 00 00 00 75 42 c9 c3 48 89 d1 48 89 f2 48 89 e6 e8 57 fe ff ff 8b 54 24 18 83 e2 01 74 0b f3 90 <8b> 54 24 18 83 e2 01 75 f5 eb ca 8b 05 2b b1 a3 01 85 c0 0f 85 72
[  292.611776] RSP: 0018:ffff9e81ca923a60 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[  292.611777] RAX: 0000000000000000 RBX: ffff91bc39b98000 RCX: 0000000000000000
[  292.611778] RDX: 0000000000000001 RSI: 00000000000000fb RDI: 0000000000000202
[  292.611779] RBP: ffff9e81ca923ab8 R08: 000000000002a670 R09: 0000000000000001
[  292.611779] R10: 0000000000001f82 R11: ffff91becf9299e0 R12: 0000000000000004
[  292.611780] R13: 000000000000000b R14: ffff91bec8e94200 R15: 0000000000000000
[  292.611780] FS:  00007f56a99ff700(0000) GS:ffff91becf900000(0000) knlGS:0000000000000000
[  292.611781] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  292.611782] CR2: 000000000022a1f4 CR3: 0000000990b24001 CR4: 00000000000226e0
[  292.611782] Call Trace:
[  292.611791]  ? crash_vmclear_local_loaded_vmcss+0xe0/0xe0 [kvm_intel]
[  292.611815]  ? restart_apic_timer+0xa0/0x190 [kvm]
[  292.611818]  vmx_vcpu_load_vmcs+0x15e/0x450 [kvm_intel]
[  292.611821]  vmx_vcpu_load+0x3b/0x190 [kvm_intel]
[  292.611833]  ? kvm_x2apic_msr_write+0x54/0x80 [kvm]
[  292.611836]  ? __switch_to_asm+0x40/0x70
[  292.611837]  ? __switch_to_asm+0x34/0x70
[  292.611837]  ? __switch_to_asm+0x40/0x70
[  292.611838]  ? __switch_to_asm+0x34/0x70
[  292.611839]  ? __switch_to_asm+0x40/0x70
[  292.611839]  ? __switch_to_asm+0x34/0x70
[  292.611840]  ? __switch_to_asm+0x34/0x70
[  292.611841]  ? __switch_to_asm+0x40/0x70
[  292.611842]  ? __switch_to_asm+0x34/0x70
[  292.611842]  ? __switch_to_asm+0x40/0x70
[  292.611843]  ? __switch_to_asm+0x34/0x70
[  292.611844]  ? __switch_to_asm+0x40/0x70
[  292.611845]  ? __switch_to_asm+0x34/0x70
[  292.611856]  kvm_arch_vcpu_load+0x6c/0x250 [kvm]
[  292.611865]  kvm_sched_in+0x34/0x40 [kvm]
[  292.611866]  finish_task_switch+0x15a/0x250
[  292.611868]  __schedule+0x2ee/0x6f0
[  292.611869]  schedule+0x33/0xa0
[  292.611878]  kvm_vcpu_block+0x84/0x310 [kvm]
[  292.611890]  kvm_arch_vcpu_ioctl_run+0x311/0x570 [kvm]
[  292.611899]  kvm_vcpu_ioctl+0x24b/0x610 [kvm]
[  292.611901]  ? do_futex+0xc7/0xc50
[  292.611902]  ? __switch_to_asm+0x40/0x70
[  292.611902]  ? __switch_to_asm+0x34/0x70
[  292.611903]  ? __switch_to_asm+0x40/0x70
[  292.611904]  ? __switch_to_asm+0x34/0x70
[  292.611905]  ? apic_timer_interrupt+0xa/0x20
[  292.611907]  do_vfs_ioctl+0xa9/0x640
[  292.611908]  ksys_ioctl+0x67/0x90
[  292.611909]  __x64_sys_ioctl+0x1a/0x20
[  292.611912]  do_syscall_64+0x57/0x190
[  292.611913]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  292.611914] RIP: 0033:0x7f58badd9427
[  292.611916] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[  292.611916] RSP: 002b:00007f56a99fa3b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  292.611917] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007f58badd9427
[  292.611918] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000020
[  292.611918] RBP: 0000000000000000 R08: 000055c141090350 R09: 00007f56a99fa1a0
[  292.611919] R10: 0000000000000001 R11: 0000000000000246 R12: 00007f56abe367c0
[  292.611919] R13: 000055c14105a2e0 R14: 00007f58ae381000 R15: 0000000000000000

Ich habe in den Sourcen gesehen, dass du da was an der Speicheraddresierung was umgebaut hast? Ich vermute hier liegt irgendwo das Problem.

Benutzeravatar
deimos
Beiträge: 5396
Registriert: 20.06.2017, 10:38
System: Alternative CCU (auf Basis OCCU)
Wohnort: Leimersheim
Hat sich bedankt: 121 Mal
Danksagung erhalten: 957 Mal
Kontaktdaten:

Re: pivccu-modules-dkms 1.0.37

Beitrag von deimos » 31.05.2020, 13:39

Hi,

an der Speicherverwaltung habe ich nichts verändert. Ich gebe jetzt nur nicht mehr den Reset Pin als GPIO raus, sondern mache den Reset komplett innerhalb des Kernel Moduls ohne Umweg über das GPIO Subsystem.
Außerdem ermittle ich die USB Endpoints anhand der Metadaten des USB Geräts und habe diese nicht mehr hardcodiert drin.

Aber nochmal die Frage: Wie ist dein Vorgehen? Machst du einen Reboot nach dem Update der Kernel Module? Läuft der Container während des Updates?

Viele Grüße
Alex

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 31.05.2020, 14:05

Ja ich habe mit Reboot nach Installation und ohne Reboot getestet. Ich hab auch einmal die Kernelmodule komplett deinstalliert, rebootet und dann erst neu installiert.
Und ja, ich hab die Module mit laufendem Container und ohne upgedatet. Die Vorgehensweise scheint egal, der Fehler kommt immer.
Ich hab ja auch sicher schon 10mal via Resetswitch den Server neu gestartet. An Reboots mangelt es also nicht :)

Ich koennte noch versuchen das lxc-start-hook.sh zeilenweise manuell auszufuehren...

quickmic
Beiträge: 518
Registriert: 20.01.2011, 14:39
Hat sich bedankt: 5 Mal
Danksagung erhalten: 4 Mal

Re: pivccu-modules-dkms 1.0.37

Beitrag von quickmic » 31.05.2020, 14:51

Problem scheint geloest zu sein:

Vorab Info:
Ich habe in der Container config noch ein weiteres USB-Geraet in den Container durchgereicht.
lxc.cgroup.devices.allow: c 188:* rwm
lxc.mount.entry: /dev/ttyElero dev/ttyUSB1 none bind,optional,create=file

Das ist ein Elero Stick, im Prinzip ein serial device.

Ich hab jetzt folgendes gemacht.
Container beendet, Container aus Autostart raus.
Kernelmodule upgedatet, Server reboot.
Dann Elerostick aus der Config rausgeschmissen, Container gestartet. -> Hat geklappt
Dann wieder Container runtergefahren, Stick wieder rein.
Container wieder gestartet -> Klappt noch immer.
Dann hab ich mir gedacht, koennte am initialen Ausfuehren des lxc-start-hook.sh liegen, weil beim ersten mal die weiteren Kernelmodule geladen werden.
Daher Elero dringelassen in der Config, und Server nochmal rebootet.
Container manuell gestartet.
Klappt aber jetzt wieder auf Anhieb, kanns also nicht gewesen sein.
Also Container wieder ins Autostart rein, und Server nochmal rebootet.
Klapt noch immer. Im Moment kann ich den Fehler also nichtmehr reproduzieren. Einerseits gut, andererseits schlecht, denn genau weiss ich auch nicht warums jetzt klappt.

Wenn der Fehler wieder auftritt, melde ich mich.

Vielen Dank einstweilen!

Antworten

Zurück zu „debmatic“