BGP Multipath load sharing iBGP and eBGP

[Giovanni (Giovanni Cesare O)]

Hi,
In my routers ( on Gns3) I saw that I have not the

bgp bestpath as-path multipath-relax command:

R1(config-router)#bgp bestpath ?
  aigp              if both paths doesn't have aigp ignore on bestpath
                    comparision
  compare-routerid  Compare router-id for identical EBGP paths
  cost-community    cost community
  igp-metric        igp metric
  med               MED attribute

R1(config-router)#

[lagapides (Lazaros Agapides)]

Hello Giovanni

It could be an IOS version issue. According to this Cisco command line reference documentation, this command was introduced in IOS XR Release 3.7.2. What version are you using?

I hope this has been helpful!

Laz

[razoleravi (Ravi K)]

Hi Rene,

can you help me the difference between hot potato routing and cold potato routing ? what are the advantages ?

[lagapides (Lazaros Agapides)]

Hello Ravi

These terms are used to refer to the ways in which ISPs handle transient traffic. It describes how traffic is handed off from one ISP to another. In this context, we’re not talking about your local ISP that provides you with connectivity, but those ISPs (Tier 1 and Tier 2) that handle backbone Internet traffic. For more info on the Tier architecture of the Internet, take a look at this post:

BGP Prevent Transit AS

Hello Giovanni You are correct, that if a provider does not allow its own network to become a transit network, then this can potentially cause problems to routing on the Internet. Remember that the Internet has a hierarchical structure. Within its structure, we have Tier 1, Tier 2, and Tier three networks. The following diagram shows an example of how these interconnect: [image] Tier 1 networks must route all traffic that they receive, to any other connected network. Tier 2 networks must …

Remember that these ISPs have multiple connections to other ISPs at various areas within their networks. When a packet is received, and it must be handed off to another ISP, it can be handed off at one of many different connection points.

Hot potato routing is the practice where ISP A will take a packet and route it to the closest available exit point of its own network to ISP B (or C, or D, or …), even if that is not the most efficient way to route it. In such a case, ISP A is essentially relieved of any further responsibility to the packet, and it is now “ISP B’s problem”. This policy is the most common that can be seen in networks, and is based on the peering agreements between ISP A and ISP B (and other ISPs). ISPs will keep track of the traffic ratio (the ratio of traffic flowing in one direction to that flowing in the other direction between peers), and if it is fairly even, then hot potato routing is acceptable and fair, because the ISPs will evenly share the burden of such exchanged traffic.

Cold potato routing is the (more expensive) practice of keeping traffic within an ISPs network for a larger part of the journey, by routing the traffic to the exit point from the ISP’s network that is closest to the final destination. This allows ISPs to provide higher quality network services to their customers. Content providers prefer the use of ISPs that offer cold potato routing because their payloads and the quality of the services they provide depend upon the timely delivery of traffic.

I hope this has been helpful!

Laz

[vkacetone (vishal k)]

Hi Rene,
How can we achieve unequal load-balancing in BGP? If we have two upstream providers, is there a way to do 60-40 loadbalancing?

[lagapides (Lazaros Agapides)]

Hello Vishal

BGP is capable of achieving unequal cost load balancing for both iBGP and eBGP. In order to do this, you must first configure the maximum-path value to be 2 or greater, as shown in the lesson. Now, if you have two paths with equal weight, local pref, AS_PATH length, Origin, and MED, then you will achieve equal cost load balancing.

To achieve unequal cost load balancing, you must use the additional feature called dmzlink-bw. This feature will enable and configure BGP to distribute traffic proportionally to the bandwidths of the links.

More information about this command, the syntax, and how it is to be used can be found at the following Cisco documentation.

IP Routing: BGP Configuration Guide - BGP Link Bandwidth [Cisco ASR 1000...

I hope this has been helpful!

Laz

[namanvohra901 (NAMAN V)]

What are advantages and disadvantages of ECMP IN BGP or common?

[lagapides (Lazaros Agapides)]

Hello Naman

You can find out a lot more details about multi path routing for BGP in the following lessons:

BGP Multipath load sharing iBGP and eBGP

BGP Additional Paths

Now the advantages of this are quite obvious. That you are making much more efficient use of the bandwidth that is available to you, and you are providing for redundant paths in the event that one path fails.

As for disadvantages, I don’t think there are any other than the fact that you should be careful how you configure it. For eBGP for example, you must make sure that you are using a loopback as the BGP source, otherwise, if the physical interface that is being used as the BGP source fails, your ECMP will fail too, even if you have an available link that is up between the BGP peers. See the eBGP Multi-Hop lesson for more info on that.

In addition, you can choose to create a different BGP session over each link, by applying multiple neighbor commands under BGP, one for each link. If you do this, BGP will initially share two copies of each prefix, but eventually, it will come down to tie-breaker rules to rule one out. In this case, you’ll have to make sure that both paths are enabled using the aforementioned lessons so that you don’t have only one link being used, and the other be idle.

So the disadvantages have more to do with ensuring that the configuration is correct, as complexity increases somewhat…

I hope this has been helpful!

Laz

[ubuntuguy123 (Nathan K)]

Hello Laz and Rene,
Thank you for all the great info. I have a real work issue that brought me to this lesson, and while it gave me a good start, I am still a little unsure on how to proceed.
My scenario is rather close to the ‘Two paths to one AS scenario’ except that each of my paths are their own router in HSRP. So I have a datacenter with two ISR’s with a separate L3VPN MPLS circuit on each. Thus far, they have been active/standby, but I would like to be active/active. I feel like I could easily replicate the scenario in the lesson by putting both circuits onto one ISR, but then I loose the device redundancy.
Does having the second router make this much more complicated? adding a simple diagram of the setup:

Edit:
Some additional thoughts. The standby routers do have their own ASN which is then prepended twice so that R1 is preferred. Would it be possible to set the ASN on both routers to be the same and then use MHSRP to load balance between the two routers? I assume this would require the ISP to engage in ECMP?

[lagapides (Lazaros Agapides)]

Hello Nathan

From my understanding, you are running HSRP on the Site-facing interfaces of R1 and R2, correct?

(From the diagram it looks like you may be running it on the MPLS-facing interfaces, something that would not work since you would have two routers with different ASNs with interfaces on the same subnet. In such a case, to what ASN does the virtual IP address belong?)

The first thing to keep in mind is that from each site, how the outgoing traffic is routed is completely in your control. You can set up HSRP to load balance outgoing traffic between the two routers by making R1 active in some subnets, and R2 active in others. You can then route traffic out via either R1 or R2. You don’t actually have to change any BGP or MPLS configuration for that.

However, if you want to load balance incoming traffic, you’ll have to take a look at the 1.1.2 Different AS section in the lesson. Because your R1 and R2 routers are in different AS’es, this scenario matches up better with what you want to do. You will have to involve the ISP in that they will have to implement BGP multipath across their MPLS network. More in this can be found here:

BGP Multipath Load Sharing for Both eBGP and iBGP in an MPLS-VPN

I hope this has been helpful!

Laz

[ndsodaro (Nicolas S)]

So if R2 and R3 advertise the same prefix to R1 and we enable this feature on it , can R1 guarantee symmetric return ? Or are we still going to have asymmetric routing

[lagapides (Lazaros Agapides)]

Hello Nicolas

The configurations created in this lesson only affect routing in the direction from R1 to the destination. It does not affect the return traffic. In order to ensure that the return traffic behaves the way you want it to, you must modify the routing on the other routers as well.

Note that the specific configurations in this lesson result in equal-cost multipath routing. How packets are distributed across the multiple paths will also depend upon the configuration of CEF.

Take a look at the following two NetworkLessons notes for more information:

• Equal-cost Multi-path routing
• CEF Load Balancing Algorithm
• BGP Equal cost multipath

I hope this has been helpful!

Laz

[konstantinos_dimos]

is there any case the rtr version not to be supported ? i am using Version 15.9(3)M2 .

[lagapides (Lazaros Agapides)]

Hello Konstantinos

The maximum-paths command has been around since IOS version 12.2 so I don’t think you’ll have a problem with your particular version. You may find that the syntax has changed a bit, and looks like this:

maximum-paths eibgp number-of-paths
and
maximum-paths ibgp number-of-paths

where the first option enables multipath for both iBGP and eBGP, while the second enables it only for iBGP. Take a look at the following command reference for more info:

https://www.cisco.com/c/en/us/td/docs/ios/iproute_bgp/command/reference/irg_book/irg_bgp3.html#wp1104794

I hope this has been helpful!

Laz

[rcrkollam (Rahul C)]

Is it possible to do loadbalance when we have Dual-Homed to One ISP Through Multiple Local Routers? is multipath should work?

[lagapides (Lazaros Agapides)]

Hello Rahul

The answer is yes, however we must understand that load balancing using BGP is very different for incoming and for outgoing traffic, regardless of the edge topology of your network.

For outgoing traffic, you control everything at the edge, so you are able to do whatever you want. Using multipath load sharing will indeed perform load balancing even if you have a dual homed arrangement to one ISP through multiple local routers. That’s the easy part.

The challenge is ensuring that your incoming traffic is load balanced. Technically, it can be done, however, you are not in control in this case. It is the ISP that’s in control. You can influence how incoming traffic is managed using various BGP attributes, but ultimately, it is the ISP that decides because they can overrule any attributes you may send them. In such a case, you should discuss with the ISP your requirements so that the edge of your network will operate as you desire.

Technically speaking, with the topology you describe, it is possible to use multipath to achieve load balancing.

I hope this has been helpful!

Laz

[rcrkollam (Rahul C)]

Thanks Laz for the review and reply, my requirement is as we have two links to one ISP with multiple routers, currently one link is active for outgoing traffic and we need to utilize the second link as well for the same outgoing traffic, like a round robin load balancing, the outgoing traffic i am referring is to internet.

Few LAN segment needs to utilize both the links at the same time to connect the internet, we are receiving the default route from both the links.While checking how to utilize both the link simultaneously, i checked the multipath option.

There is firewall in between our LAN segment and edge router which will decide where to route the internet traffic to which router, now is the primary router.The edge router are logically connected via iBGP as well