National Internet Backbone II

ENGINEERING INSTRUCTION INTRODUCTION INTRODUCTION TO NATIONAL INTERNET BACKBONE-II (NIB-II) No. NIB-II/I-002 No of Pages.

13

Issue No.

01

Issued By:

T&D, Circle

Approved By:

CGM T&D Circle

Date of Issue

28-03-2005

Amendment No (If Any)

NIL

No of Pages Issued by: Approved By: Date of Issue

Restricted use by BSNL Employees only All efforts have been made to incorporate all relevant up to date information available, any discrepancies or need for addition or deletion is felt necessary may please be intimated to this office for further improvement, on E-Mail Id [email protected].

BHARAT SANCHAR NIGAM LIMITED (A Govt. of India Enterprise) TECHNICAL & DEVELOPMENT CIRCLE, SANCHAR VIKAS BHAWAN, RESIDENCY ROAD, JABALPUR, MP-482001 1

New Technology ENGINEERING INSTRUCTIONS

NIB-II/I-002

INTRODUCTION TO NATIONAL INTERNET BACKBONE-II (NIB-II) 1.

SCOPE This Engineering Instruction presents an introduction to National Internet Backbone-II (NIB-II) conceived by BSNL to provide infrastructure for providing number of value added services to broadband customers countywide with guaranteed quality of service (QoS).

2.

GENERAL BSNL has planned to setup NIB-II to provide world class infrastructure to offer various value added services to a broader customer base county-wide that will help to accelerate the Internet revolution in India. Moreover the NIB-II will create a platform, which enables e-governance, ebanking, e-learning, etc. with the key point of Service Level Agreements & Guarantee in tune with Global standards and customer expectations. NIB-II has been grouped into following three major projects. Project 1: • MPLS based IP Network infrastructure covering 71 cities along with associated NMS, PMS, Firewall and Caching platforms. Access Gateway platform using Dialup comprising of Narrow Band RAS. Project 2.1: • Access Gateway platform comprising of Broadband RAS and DSL equipment. Project 2.2: • Messaging and Storage platform and Provisioning, Billing and Customer care Project 3: • and Enterprise management system. The network shall seamlessly integrate with the already existing network infrastructure comprising of the TCP/IP based NIB-I and MPLS VPN network. The NIB-II project comprises of Technology solutions from different product manufacturers with the provision for future expansion.

2.1

SERVICES PLANNED IN NIB-II

2.1.1

Internet Access i. Dialup access services/ Leased Access Services. ii. Digital Subscriber Line (DSL) Access Services: Broadband “always-on-internet” access over copper cables. iii. Direct Ethernet Access Services: Broadband “always-on-internet” access using Fiber-to-the-building.

2.1.2

Virtual Private Network (VPN) Services i. Layer 2 MPLS VPN Services: Point-to-point connectivity between corporate LAN sites. ii. Layer 3 MPLS VPN Intranet and Extranet Services: LAN interconnectivity between multiple Corporate LAN sites. iii. Managed Customer Premises Equipment (CPE) Services.

2.1.3

Value Added Services i. Encryption Services: One of the end-to-end data security features. ii. Firewall Services: One of the security features provided to customer. iii. Network Address Translation (NAT) Services: Service that will enable private users to access public networks.

2.1.4 2.1.5

Messaging Services Data Centre Services at Bangalore, Delhi and Mumbai

BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises Restricted to Telecom Staff

Page 2 of 13 Issue Date


2.1.6

NIB-II/I-002

Broadband Services through DSL & Direct Ethernet i. Fast Internet Access Services ii. Terminating Dialup and DSL/Direct Ethernet Customers on MPLS VPNs iii. Multicast Video Streaming Services. iv. Video on Demand Services

3.0 Network Architecture: 3.1 Core Network: The NIB-II shall constitute an integrated 2-layer IP and MPLS network. The Layer 1 network will constitute the high speed (STM-16) Backbone comprising of Core routers with built in redundancies supporting both TCP/IP and MPLS protocols with link capacities in accordance with the traffic justification. Its function will primarily be limited to high-speed packet forwarding between the core nodes. The A1 nodes (5 locations), A2 nodes (3 locations) and A3 nodes (6 locations) in the NIB-II shall form the Core layer. The five major nodes under A1 category at Mumbai, Bangalore, Delhi, Kolkata and Chennai are configured in the full mesh with link bandwidth of STM-16. The remaining 9 nodes under A2 and A3 category at Pune, Hyderabad, Ahemdabad, Luchnow, Jullundhar, Jaipur, Indore, Ernakulam and Patna are configured in dual mesh with link bandwidths of STM-16, (Refer Figure 1). Route reflectors are also provided at 4 A1 locations as shown in figure 1, which are fully meshed in the core network of NIB-II. The Route Reflector (RR) provides a mechanism for both minimizing the number of update message transmitted within the Autonomous System (AS), and reducing the amount of data that is propagated in each message. The deployment of Route Reflectors leads too much higher levels of network scalability.

Fig. 1: Core Network Architecture for NIB-II 4.0 Project 1 (MPLS based IP Network infrastructure covering 71 cities along with associated NMS, PMS, Firewall and Caching platforms.) BHARAT SANCHAR NIGAM LIMITED Page 3 of 13 A Govt of India Enterprises Issue Restricted to Telecom Staff Date


NIB-II/I-002

MPLS based network provides a cost effective way to enhance customer networking quality rather than setting up and managing individual point-to-point circuits between each office, customers need to provide only one connection from their office router to a service-provider edge router. The serviceprovider edge router either forwards the IP packets in the IP network or in the case of MPLS configured access labels the packets and routes them through its MPLS core to the edge closest to destination. IP/TCP connectivity shall be provided through Provider (P) routers and Provider Edge (PE) routers. The city-wise categorization of nodes under NIB-II Proect 1 is given in Table 1. Table 1: City-wise categorization of nodes under NIB-II Project 1 Node type No of Cities Name of cities A1 5 Chennai, Mumbai, Bangalore, Delhi and Kolkata A2 3 Hyderabad, Pune and Ahemdabad A3 6 Lucknow, Jullundhar, Jaipur, Indore, Ernakulam and Patna A4 10 Coimbtore, Chadigarh, Allahabad, Guwahati, Ranchi, Bhuvneshwar, Raipur, Manglore, Nagpur, and Vijaivwda B1 21 -B2 26 --

Devices Core router - Cisco 12416 Edge Router Cisco 7613 Core router - Cisco 12410 Edge Router Cisco 7613 Core router - Cisco 12410 Edge Router Cisco 7613 Core router - Juniper M40 Edge Router Cisco 7613

Edge Router Cisco 7613 Edge Router Cisco 7613

MPLS based network shall be a 2-layer centrally managed IP backbone network designed to provide reliable routes to cover all possible designations within and outside the country.

4.1 Network Architecture of Project 1: The Layer - 1 Core network (A1, A2, and A3 cities) shall constitute the high speed Backbone (STM-16) as shown in Figure 1. The Layer - 1 nodes shall consist of high end fully redundant Core routers, and shall be interfaced to Edge routers through Gigabit Ethernet interfaces. The Layer - 2 Edge network shall be second layer of the IP backbone network and shall primarily support MPLS edge functionality. The function of this layer shall enforce QoS and other administrative policies. This layer shall provide customer access through following three mechanisms, i. Dialup ii. Dedicated Access iii. Broadband access. This layer provides connectivity to secure VPNs as well as to Internet Data Centers. Out of total 71Edge routers, 14 are connected to the Core layer locally through the Gigbit Ethernet interfaces at the locations under A1, A2, and A3 category where core routers are provided. Remaining 57 Edge routers at locations A4, B1 and B2 locations are connected to the Core layer remotely through dual homed STM-1 links. The network is envisaged to provide QoS features associated with MPLS technology with all traffic shaping and traffic engineering features. It shall provide peering interfaces to other domains and shall serve as an Internet Exchange to ISPs. It shall support IP networking and Border Gateway Protocol (BGP)/ Multi Protocol Label Switching (MPLS) technology. The network shall support data, voice and video applications over Layer 2 and Layer 3 MPLS VPNs. The network architecture of NIB-II provides for integration of other networks such as NIB-I and MPLS VPN of BSNL. It shall provide for a common Network Management System (NMS) and VPN / BHARAT SANCHAR NIGAM LIMITED Page 4 of 13 A Govt of India Enterprises Issue Restricted to Telecom Staff Date


NIB-II/I-002

Bandwidth Provisioning System for the entire integrated IP network infrastructure. The network infrastructure for NIB-II is intended to provide IP network access both on retail as well as wholesale basis to dialup DSL and leased access customers. The network shall provide a common IP infrastructure that shall support all smaller open networks and sub-networks. 4.2 The Primary objectives in setting up the MPLS based IP network Building a common IP infrastructure that shall support all smaller networks and subnetworks. The • platform is intended to be used for convergent services, integrating data, voice and video and shall be the primary source of Internet bandwidth for ISPs, Corporate, Institutions, Government bodies and retail users. Making the service very simple for customers to use even if they lack experience in IP routing, • alongwith Service Level Agreement (SLA) offerings. Make a service very scalable and flexible to facilitate large-scale deployment. • Capable of meeting a wide range of customer requirements, including security, quality of service • (QoS), and any-to-any connectivity. Capable of offering fully managed services to customers. • 4.3 Caching Platform: The Caching platform makes the contents (HTTP, MMS, RTSP, FTP etc.) available at the POP/ Core locations and saves upstream International bandwidth. The Caching platform enables faster responses from web. The web caching solution needs to be deployed at 8 cities with International Gateways. The web caching solution should meet the bandwidth requirements and shall be scalable to future expansions of bandwidth at these locations. 4.4 Services planned to be offered under Project 1: The following services shall be offered to customers using the MPLS based IP networks . i.)

Layer 3 MPLS VPN Services Intranet-Managed & Unmanaged Extranet Managed & Unmanaged • • Internet Access services Layer 2 MPLS VPN Services Ethernet over MPLS • • Frame relay over MPLS PPP over MPLS • • Cisco HDLC over MPLS (Optional) VPLS (Virtual Private LAN service) • Layer 2 Any-to-Any Interworking (Except ATM) • Encryption Services Multicast Services Firewall Services Network Address Translation (NAT) Services •

ii.)

iii.) iv.) v.) vi.)

5. Project 2 (Access Gateway Platform) The NIB-II Access Gateway platform shall provide Internet Access at any time of the day, from any place, using any device such as PC, analog phone, wireless or mobile phone or Personal Digital Assistant (PDA). The Access Gateway Platform (AGP) is built around two distinct platforms, one supporting a unified dialing network architecture that delivers voice, data and fax services through an open programmable gateway and the other supporting a unified always-on Internet Access platform on BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises Restricted to Telecom Staff



NIB-II/I-002

Ethernet-IP. The open programmable dialing gateway is dimensioned to provide 80% plain data RAS and 20% Universal RAS ports. The always-on Internet Access platform is built around the DSL technology using ADSL, SHDSL and VDSL that delivers voice, data and video services over increasingly larger bandwidths directly on Ethernet-IP local networks to residential and corporate users, enabling applications like Broadcast TV, Video on Demand, Pay per View, Content Delivery, Interactive gaming, Music Services, Video-Conferencing, IP-Multicasting Services, Education on Demand, Interactive distant learning, Remote Medical Treatment, GIS based applications, IP PBX, IP Centrex, VoIP, VoDSL, High speed Internet, MPLS VPN etc. NIB-II Universal Access Gateway infrastructure is conceived as an open infrastructure for carrying various services. The services shall be provided to a representative sample of customers as specified in this document, while using the existing infrastructure for 6.5 lakhs subscribers. All components required for the same shall be part of the supply. The following services are proposed to be provided as part of the scope of work. (i) (ii)

Dial VPN/Internet Access service ADSL, SHDSL & VDSL IP-Ethernet High speed services (0.5 to 50 Mbps over existing Copper cables) (iii) Wholesale Dial or port retailing service (iv) Internet Call Waiting service (v) IP based Unified Messaging Service (vi) Teleconferencing Service (vii) Internet Telephony Service (viii) Hosted voice services / IP Centrex. The implementation of the Project 2 shall be deployed in two phases. • •

Project 2.1 is for narrow band access Project 2.2 is for broadband access

Project 2.1: 2.1: - This project is for the deployment of narrow band services in 71 Cities. Including validation nodes Kolkata (A1), Mumbai (A3), Agra (B1) and Shimla (B2). City-wise classification of Nodes under Project 2.1 of NIB-II is given in Tables 2 and 3. Table 2: City-wise classification of Nodes under Project 2.1 of NIB-II for L2 Bidder (M/s. UTStarcom Inc.) Type of Node

Number of Cities

Name of City

A1 A2

1 0

Kolkata --

A3 A4

5 3

Jallandhar, Mumbai, New Delhi, Lucknow, Patna,

B1 B2

6 8

Chandigarh, Guwahati, Ranchi Agra, Noida, Jammu, Amritsar, Ludhiyana, Shilong Jamshedpur, Durgapur, Siliguri, Dehradun, Ferozpur, Shimla, Ghaziabad, Meerut

Table 3: City-wise classification of Nodes under Project 2.1 of NIB-II for L1 Bidder (M/s. ITI LTD.)




5.1.1

NIB-II/I-002

Type of Node

Number of Cities

Name of City

A1 A2

2 3

Chennai, Bangalore Hyderabad, Ahemedabad, Pune

A3 A4

3 7

Ernakulam, Indore, Jaipur

B1

15

B2

18

Coimbatore, Maangalore, Vijaywada (Krishana), Bhuvneswar, Raipur, Allahabad, Nagpur Madurai, Trivendram, Mysore, Vizag, Bhopal, Gwalior, Rajkot, Surat, Vadodara, Faridabad, Gurgoan, Kanpur, Varanasi, Jodhpur, Nasik Trichy, Pondicherry, Cannanore, Paldgat, Trichure, Balgaum, Hubli, Kakinada, Cuddapah, Dimapur, Jabalpur, Mehsana, Ambala, Ajmer, Kalyan, Aurangabad, Panjim, Kolhapur

Components of Narrow Band Access Network Narrow Band Remote Access Server • LAN Switch • eMS Server •

5.2 Project 2.2: (Reference BSNL Let321ter No. 64-28/03-Internet dated 10.08.04)

5.2.1

5.2.2

This Project is for the deployment of broadband services in 198 cities with 69 important cities where Digital Subscriber Line Access Multiplexer (DSLAM) shall be deployed. The cities are categorized under A1 (3 cites), A2 (3 cites), A3 (6 cites), A4 (10 cites), B1 (21 cites), B2 (26 cites), and others (129 cities). Delhi and Mumbai will not have any broadband equipment under Project 2.2 of NIB-II. Services planned through Project 2.2 Primary source of Internet bandwidth for retail users for application such as Web • brousing, e-commerce etc Multicast video services, video on demad etc through Broadband Remote Access Server • (BRAS). • Allow wholesale BRAS ports to be assigned to smaller ISPs through the franchises model wherein the later has a separate network of DSLAMs, AAA, LDAP through a revenue scheme of BSNL. Dialup VPN (VPDN) user connects to NIB-II through the Narrow band RAS and is • connected to its private network through a secure L2TP tunnel established between Narrowband RAS and Broadband RAS. Support for both prepaid and postpaid Broadband services. •

Components of Broad Band Access Network Broad Band Remote Access Server (BBRAS) • Gigabit and Fast Ethernet Aggregation Switches (LAN Switches) • Digital Subscriber Line Access Multiplexers (DSLAMs) • SSSS/SSSC (Subscriber Service Selection System/ Centre) • Servers for AAA, LDAP at Pune • Provisioning and configuration management at NOC • The city-wise deployment of DSLAM is given in Table 4. BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises Restricted to Telecom Staff



NIB-II/I-002

Table 4: DSLAM deployment plan in 198 cities City No of DSLAM capacity requirement city wise Type Cities 480 240 120 64 48 24 A1 A2 A3 A4 B1 B2 Others

5.2.3

3 3 6 10 21 26 129 198

70 35 21 12 2 0 0

60 30 25 14 3 2 0

50 25 18 8 6 3 0

20 10 6 6 4 3 0

0 0 0 0 0 0 1

0 0 0 0 0 0 2

Total DSLAM per city 200 100 70 40 15 8 3

Total DSLAMs 600 300 420 400 315 208 387 2630

Network Architecture of Project 2.2 All 198 cities will have DSLAMs and Tier2 LAN switches (for aggregation of DSLAM). All A cities and Noida (Total 23 cities) will have one BRAS, one SSSS and one Tier 1 LAN switch. There will be no BRAS, SSSS and Tier 1 LAN switch in any other cities. All DSLAM are initially aggregated using Tier 2 LAN switch, through one pair of dark fibre. The broadband connectivity in A cities and B cities is shown in Figure 2 and Figure 3 respectively. The 240 port DSLAM will have two numbers of FE interfaces. The FX or GBIC module in DSLAM and LAN switch should be capable of driving up to 10kms on a single mode fibre. The SX or GBIC module in LAN switch used for connecting Tier2 to Tier1 will support 40kms distance. In bigger cities like A1, A2, A3 and A4, one BRAS per city will be deployed initially. There will be no BBRAS at B1 and B2 cities. The DSLAMs in B1, B2 and other lower hierarchical hierarchical cities will be aggregated through Layer 2 switches, and will be connected to the nearest BRAS of A cities on Ethernet Ethernet over SDH. The BRAS shall terminate terminate the PPP sessions sessions initiated by the customer and extend the connection further to MPLS VPN/Internet as desired by the customer. The DSLAM will in general be colocated with existing PSTN exchange, which provides last mile access to customers over copper wire up to average span lengths of 3 kms. All DSLAM will be aggregated through Fast Ethernet (FE) interface except 480 port DSLAM, which will be aggregated through Gigabit Ethernet (GigE) interface.




NIB-II/I-002

Fig. 2: Broadband connectivity Diagram in A cities

Fig. 3: Broadband connectivity Diagram in B cities 5. Project 3: BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises Restricted to Telecom Staff



NIB-II/I-002

[Messaging and Storage Service Platform, Provisioning, Billing & Customer care, Enterprise Management System (EMS) and Security System.] The Core messaging system shall be the heart of NIB-II that will enable BSNL to add users across varied value added services. This shall envisage design and up-gradation of the current messaging system to grow from the existing infrastructure in NIB-I supporting 650,000 users to support increasing user base. The messaging systems and associated Storage will be implemented in phases, in accordance with phased induction of A ccess equipment. The system shall be an integrated provisioning, billing, customer care and accounting platform and shall support billing for the complete range of IP based services mentioned and meet next-generation requirements as well. The salient aspects of the projects are summarized as follows: (i) Setting up proven, robust, scalable Messaging Solution with best in class security components. (ii) Roll out across the country supported by 5 Messaging & associated storage systems at Delhi, Mumbai, Bangalore, Chennai and Kolkata. (iii) Designed with High Availability architecture with no single point of failure. 6.1 Components of the Solution: The proposed solution shall consist of the following components with the items of functionality listed below: (i) Messaging a) DNS, AAA b) MMP c) LDAP (Consumer, Replicator Hub, Primary and Secondary) d) SMTP IN & OUT e) Messaging Servers f) Address Book Servers, etc. (ii) Storage a) SAN Switch & SAN Storage b) Tape Library c) Staging Servers, etc. 6.2 Storage platform i.

Various Applications servers placed at the 5 Messaging Storage locations like LDAP, AAA, EMS, Messaging, UMS & Billing etc. would require Data storage capacities for storing User’s mailboxes, Billing data etc. Such huge storage requirements need to be met with the Fast, Reliable & Scalable storage devices that would be deployed as “End to End High Performance Switched Architecture Fiber Channel SAN (Storage Area Networks) providing No Single Point of Failure”.

ii.

Such storage device should be compatible with all the Servers of major companies such as HP, IBM, SUN, Dell etc. so that choice of Application Servers Platform remains independent of the storage device.

6.2 System Dimensioning: The user base will be serviced through 5 Messaging and associated Storage systems that will be set up in the 5 cities. Each of the cities will be connected through the IP Backbone. Since the proposed user base is envisaged to increase in a phased manner the associated messaging system is also proposed to be upgraded in phases correspondingly.




NIB-II/I-002

6.3.1

The system should be designed to support:

(i)

(v) (vi) (vii)

On-line services such as Internet, pay-per-view TV and video on demand or a combination of all or some of the above. Periodic charges, such as telephone line and cable TV rental. One-time costs, such as connection fees. Events, such as telephone calls, data service usage, pay-per-view TV selections, home shopping purchases, utility metered usage – such as electricity supply (live site example) Financial services ASP services. Telephony services. Enterprise Backup Systems.

6.3.2

The billing system shall be capable of

(ii) (iii) (iv)

i.

6.3.3

Providing electronic versions of bills to customers over the Internet.

ii.

Creation/modification Creation/modification of service.

iii.

Processing Service requests in real time and non-real time and accounting in real time.

iv.

Producing flexible billing depending upon the use of service.

Security Systems These include the following. i. Load Balancers ii. Firewall Appliances iii. Intrusion Detection System iv. Antivirus system, etc.

7.0 Network Operation Operation Center Center (NOC) (NOC) The NOC shall provide facility for centralized Network Management and end-to-end Provisioning of multiple services, giving a single view of the entire network services being delivered countywide. The servers for the NOC shall be connected through a Gigabit Ethernet link from Core router with three zones of firewall within the Centre. The network shall be centrally managed from Network Operation Centre NOC located at two sites, one of them being master and the other the disaster recovery site. The main NOC is at Bangalore with Disaster Recovery is at Pune. Interface to the NMS back-office facility shall be provided along with Firewall security in the Data Centre. All customer databases shall reside centrally at NOC. The NMS of NIB-II project 1 is the comprehensive NMS for entire NIB-II including NIB-I, MPLS VPN, Project 2.1, Project 2.2, which will support entire F (Fault), C (Configuration), A (Accounting including Access/Inventory), P (Performance) and S (Security functionality). The conceptual view of eMS, NMS OSS/BSS for NIB-II is given in figure 4 and the connectivity Architecture of NOC at Bangalore is shown in figure 5.




NIB-II/I-002

Fig. 4: Conceptual view of eMS, NMS, EMS OSS/BSS for NIB-II

Fig. 5: Bangalore NOC Connectivity Architecture.

7.1 Service Level Agreement (SLA): It shall be possible to support SLA i.e. the level of service that the customer can expect together with any penalties to be levied by the service provider for failure to deliver. It should be possible to BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises Restricted to Telecom Staff



NIB-II/I-002

provide at least 4 classes of services. The SLA parameters shall include measurements of service delivery, availabilty, latency, throughput and restoration time etc. it should be possible to generate management reports providing information on customer node configuration and charges, faults and achievement against the SLAs. It shall be possible to deliver network management reports via a secure Website. 8.0 CONCLUSION: The installation and commissioning of project 1, project 2 under NIB-II is under progress and the centralized billing and provisioning management is planned in project 3.



National Internet Backbone II

Recommend Documents