# Single/Dual Homed and Multi-homed Designs

**URL:** <https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545>\
**Category:** Lessons Discussion\
**Created:** [March 3, 2017, 2:47pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545 "2017-03-03T14:47:41Z")\
**Posts on this page:** 20\
**Page:** 3

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [April 28, 2020, 9:12am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/43 "2020-04-28T09:12:42Z")

</div>

Hello Giovanni

VXLAN would also be a solution in this case, absolutely. You could tunnel your Layer 2 topology over the Layer 3 underlay network and get the same result. If you have a large enough network, it would definitely be more elegant than L2TPv3.

OTV differs from VXLANs in purpose. VXLANs allow you to extend your Layer 2 topology, essentially your VLANs, by tunnelling them over a Layer 3 network. This adds flexibility, ease of deployment, as well as a much larger number of manageable VLANs, which is especially useful for ISPs and datacenter providers.

OTV on the other hand is used to allow for the spanning of Layer 2 topologies across disparate and remote datacenters while at the same time, preventing the waste of precious bandwidth across the WAN, something that VXLANs are not designed to do.

This is a very simplistic view of OTV however, as it is much more involved than this, but for the purposes of this discussion, these are the primary differences, as far as this specific application is concerned.

More info about OTV can be found at [this Cisco Documentation](https://www.cisco.com/c/en/us/td/docs/solutions/Enterprise/Data_Center/DCI/whitepaper/DCI3_OTV_Intro/DCI_1.html).

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [April 28, 2020, 9:32am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/44 "2020-04-28T09:32:06Z")

</div>

Hello Dakshinamurthy

> [@dakshinaeswar](#):
>
> Here you are saying we are running EBGP between CE1 and CE2 and also EbGP peering between CE1 -ISP1 and CE2-ISP2 right ?

Yes, let me clarify. My meaning is that we are assuming that we are creating some sort of peering between the CE and ISP routers. Now this can be eBGP, it may also be iBGP, it depends on the arrangement you have with your ISPs. In any case, internal CE routers will most often have an iBGP peering, but also will be routable via their IGP internal to the enterprise network.

> [@dakshinaeswar](#):
>
> And you mentioned that there are 4 ways to influence incoming traffic. If we want to change either MED value or AS-Path prepending for example in this case, it has to be done from ISP side towards CE ?

Because inbound traffic is essentially sent to you, you do not have the ultimate control of how traffic enters your AS. Your ISPs may have outbound policies that will always override all of your attempts to influence inbound traffic. However, you do have the option of influencing inbound traffic. There are several ways to do this including:

- Leaking more specific routes - BGP will prefer more specific routes than summarizations, but some ISPs may consider this to be a “hostile” act, as it causes BGP tables to increase in size.
- Using the [MED](https://networklessons.com/bgp/how-to-configure-bgp-med-attribute) attribute
- [AS PATH prepending](https://networklessons.com/bgp/how-to-configure-bgp-as-path-prepending)
- [Community](https://networklessons.com/bgp/bgp-communities-explained)/local pref agreement

All of the above are implemented on the customer side of the connection, because this is the side that you have control over. Remember however, that the ISP has the final word for inbound traffic. For this reason, make sure to discuss your requirements with the ISP before actually implementing any of these. ISPs will usually be more than happy to accommodate your needs, and will provide you with suggested solutions to what you need. To find out more about examples or implementations of these, click on the links in the above list to see the associated lessons.

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![dakshinaeswar](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/d/85e7bf/32.png) [@dakshinaeswar](https://forum.networklessons.com/u/dakshinaeswar)\
**Post date:** [April 28, 2020, 9:50am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/45 "2020-04-28T09:50:48Z")

</div>

Many thanks for the detailed explanation. One question remains unanswered. What kind of attributes we can choose to manipulate outbound traffic ? Local preference ? or any thing else ?

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [April 29, 2020, 7:42am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/46 "2020-04-29T07:42:47Z")

</div>

Hello Dakshinamurthy

Outgoing traffic is what you have complete control over, so you can use any of the attributes that can directly be manipulated. The most commonly used, and easiest to deploy are weight and local preference. Because these are the first to be examined when selecting a BGP path, any changes to these will take precedence over any other attributes that may affect routing.

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![dakshinaeswar](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/d/85e7bf/32.png) [@dakshinaeswar](https://forum.networklessons.com/u/dakshinaeswar)\
**Post date:** [April 29, 2020, 8:26am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/47 "2020-04-29T08:26:53Z")

</div>

Thank you Laz for the clear reply.

---

<div class="post-metadata">

**Author:** ![dakshinaeswar](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/d/85e7bf/32.png) [@dakshinaeswar](https://forum.networklessons.com/u/dakshinaeswar)\
**Post date:** [May 20, 2020, 8:17pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/48 "2020-05-20T20:17:47Z")

</div>

![Multihomed network](https://cdn-forum.networklessons.com/uploads/default/original/2X/f/fc44d130d4448e12f48a8aafad1e2f5fc752c72d.jpeg)  
Hi , I have uploaded a multiohomed network with multiple routers involving two different ISP. I am trying to achive load sharing here . However my requirements are as below.

1.AS 100 accepts the local routes from both providers, along with a default for the rest of the Internet routes.  
The outbound traffic policy is:  
1.Traffic that is destined to AS 300 goes through the R1-ISP(A) link.  
2.Traffic that is destined to AS 400 goes through the R2-ISP(B) link.  
3.All other traffic should prefer default route 0.0.0.0 through the R1-ISP(A) link.  
4.If the R1-ISP(A) link fails, all traffic should go through the R2-ISP(B) link.

The inbound traffic policy is:  
1.Traffic that is destined for network 10.10.10.0/24 from the Internet should come from the ISP(A)-R1 link.  
2.Traffic that is destined for network 10.10.20.0/24 from the Internet should come from the ISP(B)-R2 link.  
3.If one ISP fails, the other ISP should route traffic back to AS 100 from the Internet for all the networks

Please note the above is taken from cisco website . They have given configurations for the same but I could not get the whole of it. Could you please explain it how well can we achieve the requirements mentioned above ?

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [May 22, 2020, 8:49am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/49 "2020-05-22T08:49:21Z")

</div>

Hello Dakshinamurthy

Remember that you have full control over traffic that is sent from your AS to other AS’es. You don’t have ultimate control over incoming traffic, however, you can influence it in various ways. For influencing incoming traffic, take a look at this post:

> [@How to configure BGP AS Path Prepending](https://forum.networklessons.com/t/how-to-configure-bgp-as-path-prepending/954/68):
>
> Hello Helen All attributes must be examined when determining which route is the best to be taken. The attributes are not separated into those that apply to inbound and those that apply to outbound routes. All attributes apply to determine the best route from the local router to a particular destination. In this sense, all attributes affect outbound traffic only. What you can do however is use some particular attributes to influence incoming traffic. This is often useful when configuring th…

If you do want to adjust incoming traffic, before you inject any BGP attributes into your ISP’s AS’es, have a chat with them and tell them what you want to do. They are often very accommodating in such cases.

Now specifically, for your outbound traffic policy, numbers 1 and 2 will happen automatically simply because of BGP routing. Number 3 can be configured most simply by adjusting the [Weight Attribute](https://networklessons.com/bgp/how-to-configure-bgp-weight-attribute). You can also [adjust other attributes](https://networklessons.com/bgp/bgp-attributes-and-path-selection) to achieve this. For a link failure (number 4) BGP will (eventually) reconverge, but you may want to use [Next Hop Tracking](https://networklessons.com/bgp/bgp-next-hop-address-tracking) and [Additinoal Paths](https://networklessons.com/bgp/bgp-additional-paths) BGP features to speed up convergence.

For inbound, as mentioned before, talk first with your ISPs. It may be that they will do all the routing for you. They may ask you to configure some things on your end as well. The attributes involved in this are those described in the [shared post above](https://forum.networklessons.com/t/how-to-configure-bgp-as-path-prepending/954/68).

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![dakshinaeswar](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/d/85e7bf/32.png) [@dakshinaeswar](https://forum.networklessons.com/u/dakshinaeswar)\
**Post date:** [May 25, 2020, 9:04am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/50 "2020-05-25T09:04:56Z")

</div>

Thank you Laz for the clear explanation.

---

<div class="post-metadata">

**Author:** ![sausageblade1](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/s/db5fbb/32.png) [@sausageblade1](https://forum.networklessons.com/u/sausageblade1)\
**Post date:** [July 15, 2020, 11:43pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/51 "2020-07-15T23:43:52Z")

</div>

I’m trying to create a network which connects to the Internet as indicated in the image below.

I have a single multihome setup with each router also connected to multilayer switches. I’d like the routers to load-balance by setting two default routes: one to the ISP and one to the other router.

 ![image](https://cdn-forum.networklessons.com/uploads/default/original/2X/c/ccdfd6f09eca43adb5d93b71ed3d8cf899ef40d7.png)

How can I prevent the routers from looping traffic and have failover to the other router if one ISP fails?

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [July 17, 2020, 7:52am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/52 "2020-07-17T07:52:22Z")

</div>

Hello Au

There are several issues to be dealt with here and several solutions for them. These include:

**Connectivity of Routers to the ISPs** - This is achieved using BGP. Typically, you have a BGP AS on your own routers, and then each ISP provides you with an AS of its own, and you create eBGP peerings. You can then adjust your BGP Attributes and parameters in the routers so that if connectivity is lost, one router will take over from the other.

**Connectivity between routers and internal MLS’es** - Here you can either use a first-hop redundancy protocol (FHRP) such as HSRP in order to allow the MLS’es to reach either router. Typically however, in such a situation, you would use some for of equal cost or unequal cost routing so that you can direct traffic to whichever edge router you want. This way, if a router is lost, routing protocols will dynamically detect this and send traffic in the appropriate direction.

**Connectivity between MLS’es and internal network** - Here in most cases you will use an FHRP such as HSRP so that internal devices will have a redundant gateway. If one of the switches fails, internal hosts will not lose connectivity, but will continue to have access using the other switch as the gateway.

In all three cases, avoiding loops on the routers simply involves employing routing protocols and configurations appropriately.

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![amarbhagwat4](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/a/53a042/32.png) [@amarbhagwat4](https://forum.networklessons.com/u/amarbhagwat4)\
**Post date:** [August 1, 2020, 4:20pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/53 "2020-08-01T16:20:19Z")

</div>

Hi Rene,  
In the example of dual homed (connected to a single ISP router using dual links), one way to load share is by configuring loopbacks on both routers, configure reachability between the loopbacks (via static route or IGP) and use update-source, ebgp multi-hop 2, commands to get the BGP up and load share across the 2 links.

Is there another way? like configure 2 neighbor statements to the same ISP router and use maximum-paths 2?

Thanks,  
Amar

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [August 3, 2020, 6:30am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/54 "2020-08-03T06:30:24Z")

</div>

Hell Amar

Actually, it is possible to create two BGP neighor adjacencies between the routers over different physical links, and load balancing will take place using the maximum-paths option. Under normal operation, this would work fine, however, in the event of a topology change, it would take some time for reconvergence to take place. With the first scenario you described, redundancy would be achieved instantaneously.

For reference, the first scenario you described can be found in detail in the second half of the following lesson:

> **[EBGP Multihop](https://networklessons.com/bgp/ebgp-multihop)**
>
> eBGP uses a TTL of 1 by default which means that neighbors should be directly connected. This lesson explains how you can change this on Cisco IOS.

Configurations that allow load balancing/sharing via BGP can be found in the following two lessons:

> **[BGP Multipath load sharing iBGP and eBGP](https://networklessons.com/bgp/bgp-multipath-load-sharing-ibgp-and-ebgp)**
>
> BGP supports ECMP (Equal Cost Multi-Path) routing but by default, it only uses a single path. Cisco IOS supports load balancing for eBGP and iBGP.

> **[BGP Additional Paths](https://networklessons.com/bgp/bgp-additional-paths)**
>
> BGP additional paths let your iBGP routers advertise multiple additional paths next to the best path. This allows you to use load balancing and multipath.

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![michaelby1](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/m/ed655f/32.png) [@michaelby1](https://forum.networklessons.com/u/michaelby1)\
**Post date:** [August 6, 2020, 7:02pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/55 "2020-08-06T19:02:12Z")

</div>

HI  
I have an usual situation,  
current set up is Nexus core 1 and 2 in a data centre running OSPF and connected to ISP1 via BGP all good so far  
Now we have a new connection via a firewall to our new ISP running BGP  
The problem I am having is the communication between 2 WAN sites that have the different ISP, they have connection problems to each other, because the core routes out via ISP1 because OSPF is the preferred protocol, but it comes back via the ISP 2.  
AS the is OSPF are 0 I am wary about redistruting the OSPF into the BGP peer that is facing ISP 2  
whats the best way?

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [August 8, 2020, 7:31am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/56 "2020-08-08T07:31:21Z")

</div>

Hello Michael

I’m having a little trouble understanding your topology. It would be helpful if you shared a diagram with us that shows both your remote (WAN) sites, as well as the datacenter core routers, firewall and ISP1 and ISP2 routers.

Laz

---

<div class="post-metadata">

**Author:** ![michaelby1](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/m/ed655f/32.png) [@michaelby1](https://forum.networklessons.com/u/michaelby1)\
**Post date:** [August 8, 2020, 7:00pm UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/57 "2020-08-08T19:00:39Z")

</div>

![routing issue](https://cdn-forum.networklessons.com/uploads/default/original/2X/0/05f149a9b77487671a5a3a2e8443943451636743.png) The Nexus 7k are in a pair running OSPF per interface between them. Currently we have 80 remote sites connected to ISP 1 only. We connected second 7k to a Fortinet Firewall and then to second ISP 2 and 1 site was added 10.65.99.12. This site has full access and functionality which we want  
All are other sites are connected to ISP 1 and they to all work fine. The problem is when these 2 sites try to talk to each other, they cant. The ISPS’s are not in HSRP so they do not talk to each other. If I do a sh ip route to 10.65.99.12 it correctly goes via second ISP, If i do the same for 25.61.31.48 it goes via core 1 which is connected to ISP 1. So they dont connect  
The BGP config is standard

```
router bgp
  router-id
  log-neighbor-changes
  address-family ipv4 unicast
    network 0.0.0.0/0
    redistribute direct route-map CONNECTED_TO_BGP
    redistribute ospf 1 route-map OSPF_TO_BGP
 
 neighbor 10.21.0.1 remote-as 65000
    update-source loopback0
    address-family ipv4 unicast
      next-hop-self

  neighbor 10.41.1.17 remote-as 
    description **WAN**
    address-family ipv4 unicast
      route-map PRIMARY_FORTIGATE in
      route-map PRIMARY_FORTIGATE_OUT out
      next-hop-self

```

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [August 11, 2020, 8:44am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/58 "2020-08-11T08:44:51Z")

</div>

Hello Michael

There are a couple of things that come to mind here. First of all, you have a site via ISP1 that is reached at 25.61.38.48 (let’s call it site 1) which is a public address. On the other hand, we have another site (site 2) connected via ISP2 with an address of 10.65.99.12, which is a private address. I’m assuming this site is connected with some kind of VPN to the firewall, and thus all connectivity between your nexus switches and this site actually occurs over private IP addresses and doesn’t touch the public Internet. One question I do have is how does site 2 reach the internet? Because when site 2 wants to communicate with 25.61.38.48, **it will go via the internet connection** , and **not via the OSPF area of the nexus switches**.

This is because on all routers, the default administrative distance for eBGP routes is 20 while for OSPF it is 110. This means eBGP routes will be preferred, so communication between the two sites will attempt to take place **over the internet at large, and not over the nexus switches**.

But site 2 can only be reached via the nexus switches, due to the fact that it is connected via a VPN, so any such communication fails.

One solution may be to change the administrative distance only for those routes for which you want to prefer OSPF rather than eBGP, but this must be done carefully, as you do not want to become a transit network for general internet traffic.

I hope this helps you out in your troubleshooting efforts!

Laz

---

<div class="post-metadata">

**Author:** ![michaelby1](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/m/ed655f/32.png) [@michaelby1](https://forum.networklessons.com/u/michaelby1)\
**Post date:** [August 21, 2020, 7:16am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/59 "2020-08-21T07:16:55Z")

</div>

Lapapides  
The 25 subnet is actually a private address! So no VPN to ISP firewal and no nat  
its simply one subnet 10.65.99 from ISP 2 can not reach 25 subnet that goes out via ISP 1

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [August 24, 2020, 6:13am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/60 "2020-08-24T06:13:36Z")

</div>

Hello Michael

> [@michaelby1](#):
>
> The 25 subnet is actually a private address!

There could be a number of things that are causing this behaviour. The first thing that comes to mind is that the 25.61.38.48 address is actually a public address, even if you are using it internally. Now when you are communicating from one site to the other, depending upon where along that path the packet reaches the network of ISP1 or ISP2, the routing found within the ISPs may route that traffic to the real destination with that address. Best practice dictates that you use [RFC1918](https://tools.ietf.org/html/rfc1918) IPv4 addresses internally to avoid such routing problems. Any BGP configuration of the ISP will prefer to send such addresses to the Internet rather than to the internal network, since eBGP has a higher priority (lower AD) than any IGP.

> [@michaelby1](#):
>
> So no VPN to ISP firewal and no nat  
> its simply one subnet 10.65.99 from ISP 2 can not reach 25 subnet that goes out via ISP 1

For me it is still not clear how the remote sites are communicating with the two Nexus 7K devices. If the connection to these devices is over an ISP, and they are using private addresses, how are you getting to those sites if not with a VPN? Can you further clarify your topology?

Regardless of this, it may be that you will simply have to examine routing along the whole path of the communication. Examine how each device along the path routes traffic between these two sites, and find out where the packets are being dropped. Once you know where, then you can further troubleshoot to determine why they are being dropped.

I hope this has been helpful!

Laz

---

<div class="post-metadata">

**Author:** ![michaelby1](https://cdn-forum.networklessons.com/letter_avatar_proxy/v4/letter/m/ed655f/32.png) [@michaelby1](https://forum.networklessons.com/u/michaelby1)\
**Post date:** [August 24, 2020, 7:23am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/61 "2020-08-24T07:23:53Z")

</div>

> [@michaelby1](#):
>
> ```auto
> redistribute direct route-map CONNECTED_TO_BGP
> 
> ```

LaZ  
The BGP config that has redistribute OSPF\_TO-BGP what is i put that also under the BGP neigjhbor 10.41.1.17 which is to ISP 2 ??

---

<div class="post-metadata">

**Author:** ![lagapidis](https://cdn-forum.networklessons.com/user_avatar/forum.networklessons.com/lagapidis/32/4949_2.png) [@lagapidis](https://forum.networklessons.com/u/lagapidis)\
**Post date:** [August 26, 2020, 5:19am UTC](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545/62 "2020-08-26T05:19:21Z")

</div>

Hello Michael

It’s still not clear to me what you want to achieve. I understand that you don’t have communication between the two network subnets/segments that you mentioned, and that the issue does look like it has to do with routing, but in order to get deeper into the reasons for this failure, it will take active troubleshooting along the routed path to determine where the packets are being dropped. Let us know some of your results of this troubleshooting so that we can further help you in resolving the problem.

I hope this has been helpful!

Laz

[Previous page](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545.md?page=2)

[Next page](https://forum.networklessons.com/t/single-dual-homed-and-multi-homed-designs/1545.md?page=4)
