Page MenuHomeVyOS Platform
Create Task
Maniphest T4588

BGP Peer Group Scaling issues
Needs reporter action, HighPublicBUG
Actions

Description

Hi Team - Great work with VYOS BTW.

Yesterday, I came across this issue - which might not necessarily be a bug, but just a limitation. I could not find any related articles, so thought of bringing this up.

I configured 1000 BGP peers via a peer-group (passive-mode). I also had 10 standalone BGP peers (not configured via peer-group) which were working just fine. Out of of 1000 peers in the peer-group, I had only 3 active peers out of which one was sending 5 routes. BGP daemon config seems to be okay while creating 1000 peers. But when I restart BGP process or reboot the box or do a VRRP failover the daemon crashes. It's stuck at 100% CPU usage. Also, it doesn't seem to be spreading the load across all cores. Only one CPU is at 100% and all others are at 0% usage.

I thought I should bring it to your attention and see if this is fixable.

Thanks
Prem

Details

Difficulty level
Normal (likely a few hours)
Version
VyOS 1.3.0-20220120155620
Why the issue appeared?
Will be filled on close
Is it a breaking change?
Unspecified (possibly destroys the router)
Issue type
Infrastructure issue or change

Event Timeline

pjeevarathinam created this task.Aug 3 2022, 2:49 PM
pjeevarathinam updated the task description. (Show Details)
pjeevarathinam updated the task description. (Show Details)
syncer edited projects, added VyOS 1.3 Equuleus (1.3.2); removed VyOS 1.3 Equuleus.Aug 14 2022, 1:05 PM
dmbaturin edited projects, added VyOS 1.3 Equuleus (1.3.3); removed VyOS 1.3 Equuleus (1.3.2).Aug 14 2022, 5:56 PM
pjeevarathinam added a comment.Aug 18 2022, 11:34 PM

I tried this command as suggested - no luck.

sudo vtysh -c 'conf' -c 'router bgp YOUR_ASN_HERE' -c 'bgp listen limit 5000'

pjeevarathinam added a comment.Aug 18 2022, 11:35 PM

I was also suggested to try this -

You can also try changing /etc/frr/daemons and append --limit-fds 500 to the BGP daemon

No luck. It crashed BGP process

syncer edited projects, added VyOS 1.3 Equuleus (1.3.4); removed VyOS 1.3 Equuleus (1.3.3).Jul 12 2023, 9:46 PM
syncer edited projects, added VyOS 1.3 Equuleus (1.3.5); removed VyOS 1.3 Equuleus (1.3.4).Aug 25 2023, 9:29 PM
Viacheslav added a subscriber: Viacheslav.Aug 30 2023, 1:47 PM

Provide some logs and examples of configuration.
Do you use SNMP?

syncer edited projects, added VyOS 1.3 Equuleus (1.3.6); removed VyOS 1.3 Equuleus (1.3.5).Dec 17 2023, 11:36 PM
dmbaturin triaged this task as High priority.Jan 10 2024, 10:31 PM
dmbaturin added a subscriber: dmbaturin.

We need to check if it's still relevant and decide if it declare it WONTFIX.

dmbaturin edited projects, added VyOS 1.4 Sagitta, VyOS 1.5 Circinus; removed VyOS 1.3 Equuleus (1.3.6).Jan 10 2024, 10:31 PM
Viacheslav added a comment.Feb 13 2024, 5:07 PM

@pjeevarathinam Could you re-check wiht 1.4-rc3 or the latest rolling?
You can play with descriptions

vyos@r4# set system frr descriptors 
Possible completions:
   <1024-8192>          Number of file descriptors
Viacheslav changed the task status from Open to Needs reporter action.Sun, Apr 7, 5:03 PM