Paolo Abeni 0a463c78d2 udp: avoid a cache miss on dequeue ...

Since UDP no more uses sk->destructor, we can clear completely
the skb head state before enqueuing. Amend and use
skb_release_head_state() for that.

All head states share a single cacheline, which is not
normally used/accesses on dequeue. We can avoid entirely accessing
such cacheline implementing and using in the UDP code a specialized
skb free helper which ignores the skb head state.

This saves a cacheline miss at skb deallocation time.

v1 -> v2:
  replaced secpath_reset() with skb_release_head_state()

Signed-off-by: Paolo Abeni <pabeni@redhat.com>
Acked-by: Eric Dumazet <edumazet@google.com>
Signed-off-by: David S. Miller <davem@davemloft.net>

2017-06-12 10:01:29 -04:00

..

netfilter

sk_buff: remove support for csum_bad in sk_buff

2017-05-19 19:21:29 -04:00

af_inet.c

net: ping: do not abuse udp_poll()

2017-06-04 22:56:55 -04:00

ah4.c

ipsec: check return value of skb_to_sgvec always

2017-06-04 23:01:47 -04:00

arp.c

neigh: Really delete an arp/neigh entry on "ip neigh delete" or "arp -d"

2017-06-04 21:37:18 -04:00

cipso_ipv4.c

netlabel: out of bound access in cipso_v4_validate()

2017-02-04 19:44:22 -05:00

datagram.c

…

devinet.c

Ipvlan should return an error when an address is already in use.

2017-06-09 12:26:07 -04:00

esp4_offload.c

esp4/6: Fix GSO path for non-GSO SW-crypto packets

2017-04-19 07:48:57 +02:00

esp4.c

ipsec: check return value of skb_to_sgvec always

2017-06-04 23:01:47 -04:00

fib_frontend.c

net: lwtunnel: Add extack to encap attr validation

2017-05-30 11:55:31 -04:00

fib_lookup.h

net: add extack arg to lwtunnel build state

2017-05-30 11:55:32 -04:00

fib_notifier.c

ipv4: fib: Remove redundant argument

2017-03-10 09:45:09 -08:00

fib_rules.c

ipv4: fib_rules: Dump FIB rules when registering FIB notifier

2017-03-16 10:18:34 -07:00

fib_semantics.c

net: add extack arg to lwtunnel build state

2017-05-30 11:55:32 -04:00

fib_trie.c

net: add extack arg to lwtunnel build state

2017-05-30 11:55:32 -04:00

fou.c

fou: make local function static

2017-05-21 13:42:36 -04:00

gre_demux.c

…

gre_offload.c

net: add recursion limit to GRO

2016-10-20 14:32:22 -04:00

icmp.c

net: ipv4: refactor __ip_route_output_key_hash

2017-05-26 14:12:49 -04:00

igmp.c

igmp, mld: Fix memory leak in igmpv3/mld_del_delrec()

2017-02-09 16:43:45 -05:00

inet_connection_sock.c

dccp: consistently use dccp_write_space()

2017-06-04 19:58:35 -04:00

inet_diag.c

tcp: remove early retransmit

2017-01-13 22:37:16 -05:00

inet_fragment.c

…

inet_hashtables.c

treewide: use kv[mz]alloc* rather than opencoded variants

2017-05-08 17:15:13 -07:00

inet_timewait_sock.c

ipv4: Namespaceify tcp_tw_recycle and tcp_max_tw_buckets knob

2016-12-29 11:38:31 -05:00

inetpeer.c

…

ip_forward.c

ipv4: allow local fragmentation in ip_finish_output_gso()

2016-11-03 16:10:26 -04:00

ip_fragment.c

inet: frag: release spinlock before calling icmp_send()

2017-03-22 15:40:45 -07:00

ip_gre.c

ip_tunnel: Allow policy-based routing through tunnels

2017-04-21 13:21:31 -04:00

ip_input.c

net: Add sysctl to toggle early demux for tcp and udp

2017-03-24 13:17:07 -07:00

ip_options.c

Replace <asm/uaccess.h> with <linux/uaccess.h> globally

2016-12-24 11:46:01 -08:00

ip_output.c

udp: avoid ufo handling on IP payload compression packets

2017-03-09 18:28:42 -08:00

ip_sockglue.c

ipv4: get rid of ip_ra_lock

2017-04-30 22:44:04 -04:00

ip_tunnel_core.c

net: add extack arg to lwtunnel build state

2017-05-30 11:55:32 -04:00

ip_tunnel.c

ip_tunnel: Allow policy-based routing through tunnels

2017-04-21 13:21:31 -04:00

ip_vti.c

vti: check nla_put_* return value

2017-05-08 15:10:31 -04:00

ipcomp.c

…

ipconfig.c

Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net

2017-04-06 08:24:51 -07:00

ipip.c

ip_tunnel: Allow policy-based routing through tunnels

2017-04-21 13:21:31 -04:00

ipmr.c

net: ipmr: add getlink support

2017-06-08 14:38:59 -04:00

Kconfig

Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/klassert/ipsec-next

2017-02-16 21:25:49 -05:00

Makefile

ipv4: fib: Move FIB notification code to a separate file

2017-03-10 09:45:09 -08:00

netfilter.c

netfilter: use skb_to_full_sk in ip_route_me_harder

2017-02-28 12:49:36 +01:00

ping.c

ping: implement proper locking

2017-03-24 20:50:28 -07:00

proc.c

tcp: add TCPMemoryPressuresChrono counter

2017-06-08 11:26:19 -04:00

protocol.c

net: Add sysctl to toggle early demux for tcp and udp

2017-03-24 13:17:07 -07:00

raw_diag.c

net: ip, raw_diag -- Use jump for exiting from nested loop

2016-11-03 15:25:26 -04:00

raw.c

ipv4, ipv6: ensure raw socket message is big enough to hold an IP header

2017-05-04 11:02:46 -04:00

route.c

ipv4: route: restore skb_dst_set in inet_rtm_getroute

2017-06-01 11:30:41 -04:00

syncookies.c

tcp: Namespaceify sysctl_tcp_timestamps

2017-06-08 10:53:29 -04:00

sysctl_net_ipv4.c

tcp: Namespaceify sysctl_tcp_timestamps

2017-06-08 10:53:29 -04:00

tcp_bbr.c

tcp: switch TCP TS option (RFC 7323) to 1ms clock

2017-05-17 16:06:01 -04:00

tcp_bic.c

tcp: bic, cubic: use tcp_jiffies32 instead of tcp_time_stamp

2017-05-17 16:06:01 -04:00

tcp_cdg.c

sched/headers: Prepare for new header dependencies before moving code to <linux/sched/clock.h>

2017-03-02 08:42:27 +01:00

tcp_cong.c

tcp: disallow cwnd undo when switching congestion control

2017-06-02 14:18:13 -04:00

tcp_cubic.c

tcp: bic, cubic: use tcp_jiffies32 instead of tcp_time_stamp

2017-05-17 16:06:01 -04:00

tcp_dctcp.c

Revert "dctcp: update cwnd on congestion event"

2016-12-06 11:34:24 -05:00

tcp_diag.c

…

tcp_fastopen.c

net/tcp_fastopen: Add snmp counter for blackhole detection

2017-04-24 14:27:17 -04:00

tcp_highspeed.c

tcp: add cwnd_undo functions to various tcp cc algorithms

2016-11-21 13:20:17 -05:00

tcp_htcp.c

tcp: replace misc tcp_time_stamp to tcp_jiffies32

2017-05-17 16:06:01 -04:00

tcp_hybla.c

tcp: make undo_cwnd mandatory for congestion modules

2016-11-21 13:20:17 -05:00

tcp_illinois.c

tcp: add cwnd_undo functions to various tcp cc algorithms

2016-11-21 13:20:17 -05:00

tcp_input.c

tcp: Namespaceify sysctl_tcp_timestamps

2017-06-08 10:53:29 -04:00

tcp_ipv4.c

tcp: add TCPMemoryPressuresChrono counter

2017-06-08 11:26:19 -04:00

tcp_lp.c

tcp: switch TCP TS option (RFC 7323) to 1ms clock

2017-05-17 16:06:01 -04:00

tcp_metrics.c

tcp: use tcp_jiffies32 to feed tp->snd_cwnd_stamp

2017-05-17 16:06:01 -04:00

tcp_minisocks.c

tcp: add a struct net parameter to tcp_parse_options()

2017-06-08 10:53:28 -04:00

tcp_nv.c

tcpnv: do not export local function

2017-05-21 13:42:36 -04:00

tcp_offload.c

…

tcp_output.c

tcp: Namespaceify sysctl_tcp_timestamps

2017-06-08 10:53:29 -04:00

tcp_probe.c

tcp: Revert "tcp: tcp_probe: use spin_lock_bh()"

2017-02-21 13:26:03 -05:00

tcp_rate.c

tcp: switch TCP TS option (RFC 7323) to 1ms clock

2017-05-17 16:06:01 -04:00

tcp_recovery.c

tcp: switch TCP TS option (RFC 7323) to 1ms clock

2017-05-17 16:06:01 -04:00

tcp_scalable.c

tcp: add cwnd_undo functions to various tcp cc algorithms

2016-11-21 13:20:17 -05:00

tcp_timer.c

tcp: fix TCP_SYNCNT flakes

2017-05-24 16:29:57 -04:00

tcp_vegas.c

tcp: make undo_cwnd mandatory for congestion modules

2016-11-21 13:20:17 -05:00

tcp_vegas.h

…

tcp_veno.c

tcp: add cwnd_undo functions to various tcp cc algorithms

2016-11-21 13:20:17 -05:00

tcp_westwood.c

tcp_westwood: use tcp_jiffies32 instead of tcp_time_stamp

2017-05-17 16:06:01 -04:00

tcp_yeah.c

tcp: add cwnd_undo functions to various tcp cc algorithms

2016-11-21 13:20:17 -05:00

tcp.c

tcp: add TCPMemoryPressuresChrono counter

2017-06-08 11:26:19 -04:00

tunnel4.c

…

udp_diag.c

…

udp_impl.h

udp: make *udp*_queue_rcv_skb() functions static

2017-05-18 10:23:33 -04:00

udp_offload.c

udp: disable inner UDP checksum offloads in IPsec case

2017-04-24 13:48:54 -04:00

udp_tunnel.c

…

udp.c

udp: avoid a cache miss on dequeue

2017-06-12 10:01:29 -04:00

udplite.c

udplite: call proper backlog handlers

2016-11-24 15:32:14 -05:00

xfrm4_input.c

esp: Add a software GRO codepath

2017-02-15 11:04:11 +01:00

xfrm4_mode_beet.c

…

xfrm4_mode_transport.c

xfrm: Add encapsulation header offsets while SKB is not encrypted

2017-04-14 10:07:39 +02:00

xfrm4_mode_tunnel.c

xfrm: Add encapsulation header offsets while SKB is not encrypted

2017-04-14 10:07:39 +02:00

xfrm4_output.c

xfrm: Add an IPsec hardware offloading API

2017-04-14 10:06:10 +02:00

xfrm4_policy.c

xfrm: policy: make policy backend const

2017-02-09 10:22:19 +01:00

xfrm4_protocol.c

xfrm: input: constify xfrm_input_afinfo

2017-02-09 10:22:17 +01:00

xfrm4_state.c

xfrm: remove unused function

2017-01-10 10:57:12 +01:00

xfrm4_tunnel.c

…