2.6.29 kernel crashes when using x86_64-4.8.02.0030-k9

[levi_pl]

Hi,

I think I narrowed down the issue from my previous post with kernel oops when using latest cisco vpn client. I'm using certificate authentication and udp tunnel with nat traversal.

Kernel build is:
Linux version 2.6.29-2-686 (Debian 2.6.29-5) (waldi@debian.org) (gcc version 4.3.3 (Debian 4.3.3-10) ) #1 SMP Sun May 17 17:56:29 UTC 2009

While on T5500 @ 1.66GHz (Dell Latitude D620) with 2GB RAM everything works fine on T7250 @2.00GHz (Dell Latitude D630) with 2GB RAM I'm getting oopses when system is genetating first IP packet.

I tried to compare systems. Both are running 32 bit identical build kernel. Userland software is identical (Debian unstable) but I don' think it's relevant to this problem.

Biggest difference is CPU. Both are Core 2, but T7250 better supports hardware virtualization. Here is difference in CPU flags:

T5500
fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm lahf_lm

T7250
fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm ida tpr_shadow vnmi flexpriority


There are other differences like ndiswrapper used on D630 but I'm getting the same results when using ethernet. D630 is using newer ICH8 chipset. Let me copy-paste output from lspci from both machines:

T5500
00:00.0 Host bridge: Intel Corporation Mobile 945GM/PM/GMS, 943/940GML and 945GT Express Memory Controller Hub (rev 03)
00:02.0 VGA compatible controller: Intel Corporation Mobile 945GM/GMS, 943/940GML Express Integrated Graphics Controller (rev 03)
00:02.1 Display controller: Intel Corporation Mobile 945GM/GMS/GME, 943/940GML Express Integrated Graphics Controller (rev 03)
00:1b.0 Audio device: Intel Corporation 82801G (ICH7 Family) High Definition Audio Controller (rev 01)
00:1c.0 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port 1 (rev 01)
00:1c.1 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port 2 (rev 01)
00:1c.2 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port 3 (rev 01)
00:1d.0 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI Controller #1 (rev 01)
00:1d.1 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI Controller #2 (rev 01)
00:1d.2 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI Controller #3 (rev 01)
00:1d.3 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI Controller #4 (rev 01)
00:1d.7 USB Controller: Intel Corporation 82801G (ICH7 Family) USB2 EHCI Controller (rev 01)
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev e1)
00:1f.0 ISA bridge: Intel Corporation 82801GBM (ICH7-M) LPC Interface Bridge (rev 01)
00:1f.2 IDE interface: Intel Corporation 82801GBM/GHM (ICH7 Family) SATA IDE Controller (rev 01)
00:1f.3 SMBus: Intel Corporation 82801G (ICH7 Family) SMBus Controller (rev 01)
03:01.0 CardBus bridge: O2 Micro, Inc. OZ601/6912/711E0 CardBus/SmartCardBus Controller (rev 40)
09:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5752 Gigabit Ethernet PCI Express (rev 02)
0c:00.0 Network controller: Broadcom Corporation BCM4311 802.11b/g WLAN (rev 01)

T7250
00:00.0 Host bridge: Intel Corporation Mobile PM965/GM965/GL960 Memory Controller Hub (rev 0c)
00:02.0 VGA compatible controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c)
00:02.1 Display controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c)
00:1a.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #4 (rev 02)
00:1a.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #5 (rev 02)
00:1a.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #2 (rev 02)
00:1b.0 Audio device: Intel Corporation 82801H (ICH8 Family) HD Audio Controller (rev 02)
00:1c.0 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 1 (rev 02)
00:1c.1 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 2 (rev 02)
00:1c.5 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 6 (rev 02)
00:1d.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #1 (rev 02)
00:1d.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #2 (rev 02)
00:1d.2 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #3 (rev 02)
00:1d.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #1 (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev f2)
00:1f.0 ISA bridge: Intel Corporation 82801HEM (ICH8M) LPC Interface Controller (rev 02)
00:1f.1 IDE interface: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) IDE Controller (rev 02)
00:1f.2 SATA controller: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) SATA AHCI Controller (rev 02)
00:1f.3 SMBus: Intel Corporation 82801H (ICH8 Family) SMBus Controller (rev 02)
03:01.0 CardBus bridge: O2 Micro, Inc. Cardbus bridge (rev 21)
03:01.4 FireWire (IEEE 1394): O2 Micro, Inc. Firewire (IEEE 1394) (rev 02)
09:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5755M Gigabit Ethernet PCI Express (rev 02)
0c:00.0 Network controller: Broadcom Corporation BCM4312 802.11b/g (rev 01)

Kernel module information
filename: /lib/modules/2.6.29-2-686/CiscoVPN/cisco_ipsec.ko
license: Proprietary
depends:
vermagic: 2.6.29-2-686 SMP mod_unload modversions 686

kernel messages after module load:
[ 1334.831187] cipsec0 (): not using net_device_ops yet
[ 1334.832392] Cisco Systems VPN Client Version 4.8.02 (0030) kernel module loaded

Session pcf settings
I removed username etc.

[main]
AuthType=3
EnableISPConnect=0
ISPConnectType=0
EnableBackup=0
EnableMSLogon=1
MSLogonType=0
EnableNat=1
TunnelingMode=0
TcpTunnelingPort=10000
CertStore=1
SendCertChain=1
PeerTimeout=90
EnableLocalLAN=0

Here is complete oops trace:
[ 140.663316] cisco_ipsec: module license 'Proprietary' taints kernel.
[ 140.684393] cipsec0 (): not using net_device_ops yet
[ 140.699986] Cisco Systems VPN Client Version 4.8.02 (0030) kernel module loaded
[ 215.564119] BUG: unable to handle kernel NULL pointer dereference at (null)
[ 215.585143] IP: [<(null)>] (null)
[ 215.595153] *pde = 00000000
[ 215.603857] Oops: 0000 [#1] SMP
[ 215.607274] last sysfs file: /sys/devices/LNXSYSTM:00/device:00/PNP0C0A:00/power_supply/BAT0/charge_full
[ 215.607274] Modules linked in: cisco_ipsec(P) xfrm_user ah6 ah4 esp6 esp4 xfrm4_mode_beet xfrm4_tunnel xfrm4_mode_tunnel xfrm4_mode_transport xfrm6_mode_tr]
[ 215.607274]
[ 215.607274] Pid: 7498, comm: corkscrew Tainted: P (2.6.29-2-686 #1) Latitude D630
[ 215.607274] EIP: 0060:[<00000000>] EFLAGS: 00010206 CPU: 1
[ 215.607274] EIP is at 0x0
[ 215.607274] EAX: f59a75c0 EBX: 24510000 ECX: f8f51fc4 EDX: f6a08000
[ 215.607274] ESI: f5c35e10 EDI: f59a75c0 EBP: f5c35e10 ESP: f47fdb04
[ 215.607274] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[ 215.607274] Process corkscrew (pid: 7498, ti=f47fc000 task=f62e5030 task.ti=f47fc000)
[ 215.607274] Stack:
[ 215.607274] f8f02222 f66bafe0 00000078 00000078 f5c35e88 8c3d5dd8 11424328 4a204ad0
[ 215.607274] 00083697 00000000 f4677808 f47fdc4c f47fdb64 f8f063ff f8f51fc4 f5108f08
[ 215.607274] f636e580 f66bafe0 00000086 f5055c08 000005dc 24510000 f4677808 24510003
[ 215.607274] Call Trace:
[ 215.607274] [<f8f02222>] CniInjectSend+0x108/0x14e [cisco_ipsec]
[ 215.607274] [<f8f063ff>] SendQueuedPackets+0x2f/0x90 [cisco_ipsec]
[ 215.607274] [<f8f06f37>] CNISend+0x127/0xa10 [cisco_ipsec]
[ 215.607274] [<f8f03563>] CniNewPacket+0x63/0xe0 [cisco_ipsec]
[ 215.607274] [<f8f02fbd>] do_cni_send+0x116/0x1be [cisco_ipsec]
[ 215.607274] [<c0280ba3>] dev_hard_start_xmit+0x1e2/0x24b
[ 215.607274] [<c028ef1b>] __qdisc_run+0xba/0x197
[ 215.607274] [<c0281035>] dev_queue_xmit+0x34a/0x443
[ 215.607274] [<c0285b9b>] neigh_resolve_output+0x1df/0x227
[ 215.607274] [<c02a03c6>] ip_finish_output2+0x18e/0x1b8
[ 215.607274] [<c029f904>] ip_local_out+0x15/0x17
[ 215.607274] [<c02a00bb>] ip_queue_xmit+0x2f0/0x337
[ 215.607274] [<c02b2327>] tcp_v4_send_check+0x7a/0xb0
[ 215.607274] [<c02aee28>] tcp_transmit_skb+0x576/0x5ad
[ 215.607274] [<c02af4c6>] tcp_connect+0x31e/0x37c
[ 215.607274] [<c02b4b22>] tcp_v4_connect+0x42b/0x489
[ 215.607274] [<c02be718>] inet_stream_connect+0x87/0x205
[ 215.607274] [<c0275d9d>] sys_connect+0x76/0xa2
[ 215.607274] [<c01796a3>] vma_adjust+0x333/0x398
[ 215.607274] [<c017796d>] free_pgtables+0x7d/0x94
[ 215.607274] [<c017e920>] free_pages_and_swap_cache+0x3b/0x48
[ 215.607274] [<c0178def>] unmap_region+0xee/0xfd
[ 215.607274] [<c0276570>] sys_socketcall+0x84/0x19f
[ 215.607274] [<c010341b>] sysenter_do_call+0x12/0x2f
[ 215.607274] Code: Bad EIP value.
[ 215.607274] EIP: [<00000000>] 0x0 SS:ESP 0068:f47fdb04
[ 216.665606] ---[ end trace 79f73e5ca5cd6d13 ]---

[xaoc]

Hi All

I've exactly the same problem!!! Any solutions?