kworker consuming cpu due to GPE13 interrupt storm on Fujitsu A544

Bug #1491467 reported by Colin Law
24
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Linux
Unknown
Unknown
linux (Ubuntu)
Invalid
Medium
Joseph Salisbury
Wily
Invalid
Medium
Joseph Salisbury

Bug Description

On Fujitsu A544 laptop (and likely others) fitted with SSD, kworker takes 100% of one core of CPU due to GPE13 interrupt storm

See upstream bug https://bugzilla.kernel.org/show_bug.cgi?id=53071

The bug can be identified by repeatedly running
cat /sys/firmware/acpi/interrupts/gpe13
where a rapidly increasing count will be seen.

Workaround:
sudo sh -c 'echo "disable" > /sys/firmware/acpi/interrupts/gpe13'
disables it until reboot
Using
sudo crontab -e
and adding the line
@reboot echo "disable" > /sys/firmware/acpi/interrupts/gpe13
works around for subsequent boots.

ProblemType: Bug
DistroRelease: Ubuntu 15.10
Package: linux-image-4.1.0-3-generic 4.1.0-3.3
ProcVersionSignature: Ubuntu 4.1.0-3.3-generic 4.1.3
Uname: Linux 4.1.0-3-generic x86_64
ApportVersion: 2.18-0ubuntu9
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: colinl 1699 F.... pulseaudio
 /dev/snd/controlC1: colinl 1699 F.... pulseaudio
CurrentDesktop: Unity
Date: Wed Sep 2 16:03:19 2015
InstallationDate: Installed on 2014-10-21 (316 days ago)
InstallationMedia: Ubuntu 14.10 "Utopic Unicorn" - Alpha amd64 (20141017)
MachineType: FUJITSU LIFEBOOK A544
ProcFB: 0 inteldrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.1.0-3-generic root=UUID=c68c6484-d8d6-44f6-b429-892aa6ef74cf ro
RelatedPackageVersions:
 linux-restricted-modules-4.1.0-3-generic N/A
 linux-backports-modules-4.1.0-3-generic N/A
 linux-firmware 1.147
RfKill:
 0: phy0: Wireless LAN
  Soft blocked: yes
  Hard blocked: no
SourcePackage: linux
UpgradeStatus: Upgraded to wily on 2015-08-31 (1 days ago)
dmi.bios.date: 04/01/2015
dmi.bios.vendor: FUJITSU // Phoenix Technologies Ltd.
dmi.bios.version: Version 1.19
dmi.board.name: FJNBB35
dmi.board.vendor: FUJITSU
dmi.chassis.type: 10
dmi.chassis.vendor: FUJITSU
dmi.modalias: dmi:bvnFUJITSU//PhoenixTechnologiesLtd.:bvrVersion1.19:bd04/01/2015:svnFUJITSU:pnLIFEBOOKA544:pvr:rvnFUJITSU:rnFJNBB35:rvr:cvnFUJITSU:ct10:cvr:
dmi.product.name: LIFEBOOK A544
dmi.sys.vendor: FUJITSU

Revision history for this message
Colin Law (colin-law) wrote :
Revision history for this message
Colin Law (colin-law) wrote :

By bisecting the kernel I have determined that the problem is not seen on the last Ubuntu 3.19 kernel 3.19.8-vivid but is seen on the first 4.0 kernel that will build using fakeroot debian/rules binary-headers binary-generic, which is

commit 636cdd7b2930ca2cdaf90eedd04fdb9fc7a8d5ec
Author: Stefan Bader <email address hidden>
Date: Thu Feb 14 09:55:49 2008 -0500

    UBUNTU: SAUCE: (no-up) ubuntu: dm-raid45

from https://code.launchpad.net/~ubuntu-kernel/ubuntu/+source/linux/+git/wily

It also exists on the latest mainline kernel 4.2.0

Revision history for this message
Brad Figg (brad-figg) wrote : Status changed to Confirmed

This change was made by a bot.

Changed in linux (Ubuntu):
status: New → Confirmed
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I'd like to perform a bisect to figure out what commit caused this regression. We need to identify the earliest kernel where the issue started happening as well as the latest kernel that did not have this issue.

Before we start the bisect, can you first confirm that 3.19 final does not have the bug an 4.0-rc1 does have it? The two kernels can be downloaded from:

v3.19 final: http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.19-vivid/
4.0-rc1: http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.0-rc1-vivid/

Thanks in advance!

Changed in linux (Ubuntu):
importance: Undecided → Medium
Changed in linux (Ubuntu Wily):
assignee: nobody → Joseph Salisbury (jsalisbury)
status: Confirmed → In Progress
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Also, can you test the latest mainline kernel, 4.2 final? I'd like to confirm the bug is not fixed in mainline yet. If it is, we can perform a "Reverse" bisect to identify the commit that is the fix. The mainline kernel can be downloaded from:

http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.2-unstable/

Revision history for this message
Colin Law (colin-law) wrote :
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Great, thanks for testing. I'll start the bisect and post the first test kernel shortly.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I started a kernel bisect between v3.19 final and v4.0-rc1. The kernel bisect will require testing of about 7-10 test kernels.

I built the first test kernel, up to the following commit:
02f1f2170d2831b3233e91091c60a66622f29e82

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

02f1f2170d2831b3233e91091c60a66622f29e82
http://kernel.ubuntu.com/~jsalisbury/lp1491467
linux-image-3.19.0-031900-generic_3.19.0-031900.201509021605_amd64.deb

is BAD
that is it shows the bug.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Thanks, I'll build the next test kernel.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
c5ce28df0e7c01a1de23c36ebdefcd803f2b6cbb

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

c5ce28df0e7c01a1de23c36ebdefcd803f2b6cbb
linux-image-3.19.0-031900-generic_3.19.0-031900.201509022146_amd64.deb

is GOOD :)

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
718749d56214aa97015fe01b76b6d6dd0c171796

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

718749d56214aa97015fe01b76b6d6dd0c171796
linux-image-3.19.0-031900-generic_3.19.0-031900.201509031253_amd64.deb

is GOOD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
b3d6524ff7956c5a898d51a18eaecb62a60a2b84

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

b3d6524ff7956c5a898d51a18eaecb62a60a2b84
linux-image-3.19.0-031900-generic_3.19.0-031900.201509031452_amd64.deb

is GOOD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
8cc748aa76c921d8834ef00f762f31acd2c93aa8

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

8cc748aa76c921d8834ef00f762f31acd2c93aa8
linux-image-3.19.0-031900-generic_3.19.0-031900.201509031637_amd64.deb

is BAD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
d3f180ea1a44aecba1b0dab2a253428e77f906bf

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

d3f180ea1a44aecba1b0dab2a253428e77f906bf
linux-image-3.19.0-031900-generic_3.19.0-031900.201509032049_amd64.deb

is GOOD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
ba4877b9ca51f80b5d30f304a46762f0509e1635

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

ba4877b9ca51f80b5d30f304a46762f0509e1635
linux-image-3.19.0-031900-generic_3.19.0-031900.201509041408_amd64.deb

is GOOD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
7b1ee96f074cc931a2c226b33607fe7a74d5cba3

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

7b1ee96f074cc931a2c226b33607fe7a74d5cba3
linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509050242_amd64.deb

is BAD

Revision history for this message
Colin Law (colin-law) wrote :

As a matter of interest, which repository have you cloned from?

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

This is the repo I am using:
git://git.launchpad.net/~ubuntu-kernel/ubuntu/+source/linux/

I built the next test kernel, up to the following commit:
875edad528cf29b382e82837e652e997aec16c49

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

875edad528cf29b382e82837e652e997aec16c49
linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509081446_amd64.deb

is GOOD

Revision history for this message
Colin Law (colin-law) wrote :

Can you confirm the repo please, I get
$ git clone git://git.launchpad.net/~ubuntu-kernel/ubuntu/+source/linux/
Cloning into 'linux'...
fatal: remote error: Repository '~ubuntu-kernel/ubuntu/+source/linux' not found.

Alternatively is it fundamentally the same (as far as this exercise is concerned) as
https://git.launchpad.net/~ubuntu-kernel/ubuntu/+source/linux/+git/wily

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
afb5abc262e962089ef2d7c2bbf71bb6f53a2a78

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

As far as my repo, I should have posted:
git://kernel.ubuntu.com/ubuntu/linux.git

What I posted in comment 26 was part of the path to my Wily remote.

Revision history for this message
Colin Law (colin-law) wrote :

afb5abc262e962089ef2d7c2bbf71bb6f53a2a78
/home/colinl/Downloads/linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509081446_amd64.deb

is GOOD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
30fc8d138e9123f374a3c3867e7c7c5cd4004941

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

30fc8d138e9123f374a3c3867e7c7c5cd4004941
linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509081948_amd64.deb

is Bad

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
71ed848fd791bc0b53a1b7a04f29eb9e994c7cbb

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

I don't think you have actually, there's nowt there :)

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Sorry, my scp timed out. They should be there now.

Revision history for this message
Colin Law (colin-law) wrote :

71ed848fd791bc0b53a1b7a04f29eb9e994c7cbb
linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509091541_amd64.deb

is BAD

Only one, or two, to go :)

Revision history for this message
Colin Law (colin-law) wrote :

It may be of interest that another A544 running kernel 3.13 exhibits the problem. It went away some time between then and 3.19 and came back in 4.0. The other machine does not have an SSD so that may not be a factor, though comments in the upstream bug suggested that it was a factor. Of course there may be multiple causes for apparently similar symptoms.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I built the next test kernel, up to the following commit:
0dc553652102c55a43eb1ab52e2049e478469f53

The test kernel can be downloaded from:
http://kernel.ubuntu.com/~jsalisbury/lp1491467

Can you test that kernel and report back if it has the bug or not? I will build the next test kernel based on your test results.

Thanks in advance

Revision history for this message
Colin Law (colin-law) wrote :

0dc553652102c55a43eb1ab52e2049e478469f53
linux-image-3.19.0-031900rc4-generic_3.19.0-031900rc4.201509092055_amd64.deb

is BAD

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

The bisect reported the following commit as the commit that introduced the regression:

commit 0dc553652102c55a43eb1ab52e2049e478469f53
Author: Jarkko Sakkinen <email address hidden>
Date: Fri Dec 12 11:46:35 2014 -0800

    tpm: fix raciness of PPI interface lookup

I'll build a test kernel with just this commit reverted to see if it fixes the bug.

Revision history for this message
Colin Law (colin-law) wrote :

Have I missed something or has it not arrived yet?

I have gone back and confirmed that afb5abc262e962089e was good and 0dc553652102c55a4 is bad, just in case I had made a mistake.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

No, there is no test kernel available yet. I attempted a revert of commit 0dc5536. However, the revert requires that other commits be reverted first.

I also need to ping the patch author that this commit is the cause of the regression.

Revision history for this message
Colin Law (colin-law) wrote :

OK. In case it is of interest I have determined that the problem was originally fixed between mainline kernels 3.13.11.11-trusty and 3.14-rc1-trusty, before being reintroduced in 4.0.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Thanks for the info. The 4.3-rc1 kernel is now available. It might be worthwhile giving that kernel a test. It can be downloaded from:

http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.3-rc1-unstable/

Revision history for this message
Colin Law (colin-law) wrote :

I think 4.3-rc1 kernel build has failed, at least there are no images there. I will test it when they appear.

Revision history for this message
Colin Law (colin-law) wrote :

4.3-rc1 kernel (linux-image-4.3.0-040300rc1-generic_4.3.0-040300rc1.201509160642_amd64.deb) also exhibits the problem.

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

The patch author requested an acpidump. Could you provide this? It can be done by installing the acpidump package the running:
 sudo acpidump -o acpidump.txt

Revision history for this message
Colin Law (colin-law) wrote :
Revision history for this message
Colin Law (colin-law) wrote :

Is anything happening on this?

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

I will ping upstream again and see if there is an update.

Revision history for this message
Manuel (gmanuel89) wrote :

I am using a Fujitsu Lifebook A544, with normal HDD and optical drive.

The high-cpu load issue is present with kernel 3.19 (Ubuntu Trusty), 4.2 (Ubuntu Wily and Fedora 23) and 4.3 (Ubuntu Xenial), with BIOS 1.18 and 1.19. Moreover, the optical drive seems to be unable to read CDs and DVDs.

After upgrading the BIOS to 1.20, the problem disappears with all the aforementioned kernels, and the optical drive is back to reading CDs and DVDs again.

I believe that the issue was known by Fujitsu itself, since it reports the bug as fixed in the BIOS 1.19-1.20 changelog.

I am wondering if upgrading the BIOS solves the problem also for the SSD-equipped laptop.

Revision history for this message
Colin Law (colin-law) wrote :

I can confirm that updating to BIOS 1.20 also fixes it for me (with SSD drive). Strange that the problem only exhibited itself with certain kernel versions. So it seems Joseph and myself have wasted our time bisecting the kernel. Sorry Joseph. I learnt a lot in the process however. I will close the bug, I presume that correct status is ' invalid'.

Changed in linux (Ubuntu):
status: In Progress → Invalid
Changed in linux (Ubuntu Wily):
status: In Progress → Invalid
Revision history for this message
Luis Alberto Pabón (copong) wrote :

I can confirm that on a clean install of 16.04 and kernel 4.4 and BIOS 1.10 this issue was also present, and also disappeared after upgrading the BIOS to 1.20.

Revision history for this message
Koby (kobayashison) wrote :

On my Samsung NP700Z3C I discovered that the gpe13 is triggered if no disk is loaded in the slot-loading ODD (TSSTcorp SU-208CB). I noticed that the Fujitsu A544 has the same drive.
https://bugzilla.kernel.org/show_bug.cgi?id=53071#c75

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.