cyclictest abnormal on Ubuntu 24.04 lowlatency

Asked by Yuan-Kang Shih

# uname -a
Linux 3081u2404 6.8.0-31-lowlatency #31.1-Ubuntu SMP PREEMPT_DYNAMIC Sat Apr 20 01:05:08 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

# cat /proc/cmdline
BOOT_IMAGE=/vmlinuz-6.8.0-31-lowlatency root=/dev/mapper/ubuntu--vg-ubuntu--lv ro crashkernel=auto rhgb quiet processor.max_cstate=1 intel_idle.max_cstate=0 intel_pstate=disable idle=poll intel_iommu=on iommu=pt selinux=0 enforcing=0 nmi_watchdog=0 audit=0 mce=off kthread_cpus=0 irqaffinity=0 console=tty0 console=ttyS0,115200n8 skew_tick=1 nosoftlockup isolcpus=managed_irq,domain,1-31 nohz=on nohz_full=1-31 rcu_nocbs=1-31 numa=on

# cyclictest -m -p95 -d0 -a 0-31 -t 32
# /dev/cpu_dma_latency set to 0us
policy: fifo: loadavg: 0.37 0.57 0.33 1/439 1825

T: 0 ( 1785) P:95 I:1000 C: 80736 Min: 4 Act: 4 Avg: 4 Max: 121
T: 1 ( 1786) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 5 Max: 77
T: 2 ( 1787) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 5 Max: 57
T: 3 ( 1788) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 4 Max: 10
T: 4 ( 1789) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 4 Max: 11
T: 5 ( 1790) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 4 Max: 8
T: 6 ( 1791) P:95 I:1000 C: 80736 Min: 4 Act: 6 Avg: 4 Max: 25
T: 7 ( 1792) P:95 I:1000 C: 80736 Min: 4 Act: 5 Avg: 4 Max: 14
T: 8 ( 1793) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 115
T: 9 ( 1794) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 64
T:10 ( 1795) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 78
T:11 ( 1796) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 25
T:12 ( 1797) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 17
T:13 ( 1798) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 11
T:14 ( 1799) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 9
T:15 ( 1800) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 8
T:16 ( 1801) P:95 I:1000 C: 80735 Min: 4 Act: 6 Avg: 4 Max: 18
T:17 ( 1802) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 5 Max: 8
T:18 ( 1803) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 4 Max: 50
T:19 ( 1804) P:95 I:1000 C: 80735 Min: 4 Act: 5 Avg: 5 Max: 78
T:20 ( 1805) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 62
T:21 ( 1806) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 8
T:22 ( 1807) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 5 Max: 16
T:23 ( 1808) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 10
T:24 ( 1809) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 8
T:25 ( 1810) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 5 Max: 8
T:26 ( 1811) P:95 I:1000 C: 80733 Min: 4 Act: 5 Avg: 4 Max: 63
T:27 ( 1812) P:95 I:1000 C: 80734 Min: 4 Act: 6 Avg: 4 Max: 11
T:28 ( 1813) P:95 I:1000 C: 80734 Min: 4 Act: 6 Avg: 4 Max: 43
T:29 ( 1814) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 4 Max: 38
T:30 ( 1815) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 5 Max: 19
T:31 ( 1816) P:95 I:1000 C: 80734 Min: 4 Act: 5 Avg: 5 Max: 61

The Max part is out of our expect.
Moreover when we executed "df" command in another terminal, the Max part growth to around 3000.
The result is shown below.

root@3081u2404:/home/faca# cyclictest -m -p95 -d0 -a 0-31 -t 32
# /dev/cpu_dma_latency set to 0us
policy: fifo: loadavg: 0.05 0.17 0.21 1/440 1872

T: 0 ( 1785) P:95 I:1000 C:1079370 Min: 4 Act: 4 Avg: 4 Max: 3013
T: 1 ( 1786) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 5 Max: 2882
T: 2 ( 1787) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 5 Max: 2793
T: 3 ( 1788) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 5 Max: 2702
T: 4 ( 1789) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 4 Max: 2621
T: 5 ( 1790) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 4 Max: 2533
T: 6 ( 1791) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 4 Max: 2452
T: 7 ( 1792) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 5 Max: 2367
T: 8 ( 1793) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 3058
T: 9 ( 1794) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 2868
T:10 ( 1795) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 4 Max: 2883
T:11 ( 1796) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 4 Max: 2741
T:12 ( 1797) P:95 I:1000 C:1079371 Min: 4 Act: 5 Avg: 5 Max: 2658
T:13 ( 1798) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 2571
T:14 ( 1799) P:95 I:1000 C:1079370 Min: 4 Act: 4 Avg: 4 Max: 2485
T:15 ( 1800) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 5 Max: 2394
T:16 ( 1801) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 2310
T:17 ( 1802) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 5 Max: 2219
T:18 ( 1803) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 4 Max: 3110
T:19 ( 1804) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 5 Max: 3021
T:20 ( 1805) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 4 Max: 2952
T:21 ( 1806) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 2744
T:22 ( 1807) P:95 I:1000 C:1079370 Min: 4 Act: 6 Avg: 5 Max: 2658
T:23 ( 1808) P:95 I:1000 C:1079370 Min: 4 Act: 5 Avg: 4 Max: 2570
T:24 ( 1809) P:95 I:1000 C:1079370 Min: 4 Act: 6 Avg: 4 Max: 2485
T:25 ( 1810) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 5 Max: 2394
T:26 ( 1811) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 4 Max: 2800
T:27 ( 1812) P:95 I:1000 C:1079369 Min: 4 Act: 4 Avg: 4 Max: 2299
T:28 ( 1813) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 4 Max: 2210
T:29 ( 1814) P:95 I:1000 C:1079368 Min: 4 Act: 5 Avg: 4 Max: 3097
T:30 ( 1815) P:95 I:1000 C:1079369 Min: 4 Act: 5 Avg: 5 Max: 2823
T:31 ( 1816) P:95 I:1000 C:1079368 Min: 4 Act: 5 Avg: 5 Max: 3007

Do you know the root cause or something wrong when we set in the /etc/defaut/grub?
We do not see the same symptom on Ubuntu 22.04 lowlatency kernel.

Question information

Language:
English Edit question
Status:
Open
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:

Can you help with this problem?

Provide an answer of your own, or ask Yuan-Kang Shih for more information if necessary.

To post a message you must log in.