Saturday, March 30, 2013

(IPMP vs LACP) vs MPIO

If you're running an illumos or Solaris-based distribution for your ZFS needs, especially in a production environment, you may find yourself wanting to aggregate multiple network interfaces either for performance, redundancy, or both. With Solaris, your choices are not limited to standard LACP.

So first, in case you're not aware, LACP is a link aggregation technology well supported by most operating systems and switches. It is sometimes called bonding, NIC teaming, and so on. You can get a pretty thorough write-up on it from Wikipedia.

IPMP is a Solaris technology that is similar to LACP, but superior in a number of ways, but most non-Solaris admins are generally unaware of its existence. Due to the rise of ZFS even within otherwise Linux-only environments, I often see administrators setting up and running with LACP when IPMP would have been a better fit, but they were simply unaware they had an option. I'm not going to wax on about IPMP or its virtues - a quick Google search will find you plenty of information. In a nutshell, it is different from LACP (running at the IP layer instead of the MAC layer), can actually be run in conjunction with LACP, and has some benefits and some drawbacks compared to an LACP aggregate.

No, what I want to take a moment to do is add this blog to the long list of sources that will explain something - LACP and IPMP and similar technologies increase the number of lanes on your highway - but each individual client generally only still has the 1 car, and the speed limit remains the same. Using LACP to aggregate 2, 4, or more NIC's together will improve your aggregate throughput speeds, but will not increase the speed of any individual stream of data past that of a single NIC within the aggregate.

Neither technology should be looked at as a means by which to improve the speed one client to hit one server with - for instance, if your client has a 10Gbit NIC and your server has 4x1Gbit NIC's, bonding all four 1 Gbit NIC's together with either technology will not then allow the client to send it data at 4 Gbit/s - it will still only go at 1 Gbit/s. Often even if you enable bonding on both client and server, the single-transfer throughput will remain one NIC's worth (but multiple transfers may, depending on settings, be capable of going down other links in the aggregate, thus allowing multiple link-speed transfers at once).

With that out of the way, what I often run into as well is client sites where they've set up ZFS appliances for use mostly or even entirely with iSCSI clients, and then used LACP or IPMP (or both). This is a mistake. The default iSCSI initiators for both Linux and Windows clients support iSCSI MPIO, a technology that will provide you with most the benefits of LACP or IPMP (namely, failover, and aggregation of multiple interfaces), and add to that the actual ability to increase the speed of single transfers beyond that of a single interface.

iSCSI MPIO does require support on the server side as well, and often a specific setup to allow it. If you are using NexentaStor or a similar OS, rather than rewrite things I've already written, I'll merely link you to a Solutions guide I already wrote (if you're not running Nexenta, both the client and server side advice translate, so long as it is COMSTAR you're using on the server side). If you're running Linux, I don't currently have an answer for you (I've avoided the ZFS on Linux project to date, as I'm busy and am waiting for it to reach a 1.0 state, as I tend to distrust anything that the maintainer of feels isn't ready to carry a 1.0 moniker), but I suspect Google can assist you, it is Linux after all. If you're running FreeBSD, I believe istgt supports MPIO, and merely requires you set up the Portal Group with more than one interface to allow it. That's second-hand information, I'm afraid, as my own home setup has a mere single port on it; if/when I can acquire hardware to change that, I'll do a post with exact configuration and testing results.

I highly recommend investigating MPIO for iSCSI in lieu of even turning on LACP or IPMP, if your setup is 100% iSCSI. If you've also got NFS/CIFS/etc in there, at the moment most of the file level protocols don't support any form of MPIO, so network link aggregation is still a requirement, and in such an event I'd only caution that when configuring them, try to configure things in such a way that MPIO can still work, if you've got some % of iSCSI in there.

100 comments:

  1. It is a wonderful blog. Thanks for sharing like this blog.......

    Best Training Institute in chennai

    ReplyDelete
    Replies
    1. IEEE Final Year Project centers make amazing deep learning final year projects ideas for final year students Final Year Projects for CSE to training and develop their deep learning experience and talents.

      IEEE Final Year projects Project Centers in India are consistently sought after. Final Year Students Projects take a shot at them to improve their aptitudes, while specialists like the enjoyment in interfering with innovation.

      corporate training in chennai corporate training in chennai

      corporate training companies in india corporate training companies in india

      corporate training companies in chennai corporate training companies in chennai

      I have read your blog its very attractive and impressive. I like it your blog. Digital Marketing Company in Chennai

      Delete
  2. When I initially commented, I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several emails with the same comment. Is there any way you can remove people from that service? Thanks.

    Advanced AWS Training in Bangalore | Amazon Web Services Training in Bangalore
    Amazon Web Services Training in Pune | Best AWS Training in Pune
    AWS Online Training | Online AWS Certification Course - Gangboard
    Top 110 AWS Interview Question and Answers | Advanced AWS interview Questions and Answers – AWS jobs

    ReplyDelete
  3. I really like your blog. You make it interesting to read and entertaining at the same time. I cant wait to read more from you.
    online Python training
    python training in chennai

    ReplyDelete
  4. Great content thanks for sharing this informative blog which provided me technical information keep posting.
    Best Devops Training in pune
    Devops interview questions and answers
    Devops interview questions and answers

    ReplyDelete
  5. Well done! Pleasant post! This truly helps me to discover the solutions for my inquiry. Trusting, that you will keep posting articles having heaps of valuable data. You're the best! 
    python course in pune
    python course in chennai
    python Training in Bangalore

    ReplyDelete
  6. I found your blog while searching for the updates, I am happy to be here. Very useful content and also easily understandable providing.. Believe me I did wrote an post about tutorials for beginners with reference of your blog.

    rpa training in chennai |rpa course in chennai|
    rpa training in bangalore | best rpa training in bangalore | rpa course in bangalore | rpa training institute in bangalore | rpa training in bangalore | rpa online training

    ReplyDelete
  7. Useful information.I am actual blessed to read this article.thanks for giving us this advantageous information.I acknowledge this post.and I would like bookmark this post.Thanks
    Best Devops online Training
    Online DevOps Certification Course - Gangboard

    ReplyDelete
  8. Really very nice blog information for this one and more technical skills are improve,i like that kind of post.

    rpa training in chennai |best rpa training in chennai|
    rpa training in bangalore | best rpa training in bangalore

    ReplyDelete
  9. Whoa! I’m enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appeal. I must say you’ve done a very good job with this.
    AWS Training in Bangalore |Best AWS Training Institute in Bangalore BTM, Marathahalli
    AWS Training in Chennai | AWS Training Institute in Chennai Velachery, Tambaram, OMR

    ReplyDelete

  10. Whoa! I’m enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appeal. I must say you’ve done a very good job with this.

    AWS TRAINING IN BANGALORE|NO.1AWS TRAINING INSTITUTES IN BANGALORE

    ReplyDelete

  11. Nice posting..thanks.
    Ijin..info investasi lahan keluarga di San Diego Hills memorial Park bebas biaya perawatan dan kebersihan selamanya klik
    Best Ice Fishing Gloves Best Ice Fishing Gloves Best Ice Fishing Gloves


    ReplyDelete
  12. Thanks For Sharing The Information The Information Shared Is Very Valuable Please Keep Updating Us Time Just Went On Reading The article Python Online Course Hadoop Online Course Aws Online Course Data Science Online Course

    ReplyDelete
  13. Started out in 2012, Data Science Central is one of the industry’s leading and fastest growing Internet
    community for data practitioners. Whether it is data science or machine learning or deep learning or
    big data, Data Science Central is a one-stop shop that covers a wide range of data science topics that
    includes technology, tools, data visualisation, code, and job opportunities. Also, many industry experts
    contribute to the community forum for discussion or questions.

    DATA SCIENCE Training in OMR Chennai

    ReplyDelete
  14. A befuddling web diary I visit this blog, it's incredibly grand. Strangely, in this present blog's substance made motivation behind fact and sensible. The substance of information is instructive
    Oracle Fusion Financials Online Training
    Oracle Fusion HCM Online Training
    Oracle Fusion SCM Online Training

    ReplyDelete
  15. Attend The Python Training in Bangalore From ExcelR. Practical Python Training in Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Python Training in Bangalore.

    ReplyDelete
  16. Hi Friends, I have sifted yesterday from Delhi to Mumbai and I reached my destination. Before sifting I was very worried about my households, how I will manage about those items that I started to search Packers and Movers on the internet. I saw so many there that I took a risk because I haven't any idea of Packers and Movers and called to Agarwal Packers and Movers. Their staff came and start doing there work. I can't believe After watching their work I was so impressed and glad too.

    Agarwal Packers Reviews
    Agarwal Packers Feedback
    Agarwal Packers Complaint

    ReplyDelete
  17. A bewildering web journal I visit this blog, it's unfathomably heavenly. Oddly, in this present blog's substance made purpose of actuality and reasonable. The substance of data is informative
    Oracle Fusion Financials Online Training
    Oracle Fusion HCM Online Training
    Oracle Fusion SCM Online Training

    ReplyDelete
  18. I like viewing web sites which comprehend the price of delivering the excellent useful resource Python training in pune free of charge. I truly adored reading your posting. Thank you!

    ReplyDelete
  19. Thanks for taking time for sharing this article, it was excellent and very informative. Its really very useful of all of users. I found a lot of informative stuff in your article. Keep it up. Best Graphic Designing Company in Noida

    ReplyDelete
  20. Thanks for taking time for sharing this article, it was excellent and very informative. Its really very useful of all of users. I found a lot of informative stuff in your article. Keep it up. Online Effluent Monitoring System

    ReplyDelete
  21. Great Post ,thanks for sharing this informative blog which provided me technical information. I really appreciate, keep posting!! Machine Learning Course

    ReplyDelete
  22. Attend The Data Analytics Course in Bangalore From ExcelR. Practical Data Analytics Course in Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Analytics Course in Bangalore.
    ExcelR Data Analytics Course in Bangalore

    ReplyDelete
  23. Very interesting blog Thank you for sharing such a nice and interesting blog and really very helpful article.sap training in bangalore

    ReplyDelete
  24. Its really helpful for the users of this site. I am also searching about these type of sites now a days. So your site really helps me for searching the new and great stuff.other training in bangalore

    ReplyDelete
  25. Nice post. It is really interesting. Thanks for sharing the post...
    RPA Training in Bangalore - Marathahalli | RPA Training Institutes | RPA Course Fees and Content | RPA Interview Questions
    - ECare Technologies located in Marathahalli - Bangalore, is one of the best RPA Training institutes with 100% Placement support. RPA Training in Bangalore provided by RPA Certified Experts and real-time Working Professionals with handful years of experience in real time RPA Projects.

    ReplyDelete
  26. Nice post...Thanks for sharing...
    AWS Training in Bangalore | AWS Cours | AWS Training Institutes - RIA Institute of Technology
    - Best AWS Training in Bangalore, Learn from best AWS Training Institutes in Bangalore with certified experts & get 100% assistance.

    ReplyDelete
  27. It is a wonderful blog. Thanks for sharing like this blog...
    AWS Course in Bangalore

    ReplyDelete

  28. Awesome blog. I enjoyed reading your articles.

    click here for more info

    ReplyDelete
  29. Effective blog with a lot of information. I just Shared you the link below for Courses .They really provide good level of training and Placement,I just Had RPA Classes in this institute , Just Check This Link You can get it more information about the RPA course.


    Java training in chennai | Java training in annanagar | Java training in omr | Java training in porur | Java training in tambaram | Java training in velachery

    ReplyDelete
  30. https://www.blackhatworld.com/members/manhinhmaytinhcu.1403852/
    http://muabanon.com/member.aspx

    ReplyDelete
  31. Attend The Business Analytics Course From ExcelR. Practical Business Analytics Course Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Analytics Course.
    Business Analytics Course

    ReplyDelete
  32. I must appreciate you for providing such a valuable content for us. This is one amazing piece of article. Helped a lot in increasing my knowledge.
    AWS training in chennai | AWS training in annanagar | AWS training in omr | AWS training in porur | AWS training in tambaram | AWS training in velachery

    ReplyDelete
  33. Attend The Data Analyst Course From ExcelR. Practical Data Analyst Course Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Analyst Course.
    Data Analyst Course

    ReplyDelete
  34. Read your blog, Excellent content written on Random storage industry dude's blog, mostly about ZFS and related technology.

    If you are looking for AWS job with unexpected Pay, then visit below link

    AWS Training in Chennai
    AWS course in Chennai
    AWS Certification in Chennai
    AWS Training
    Best AWS Training in Chennai
    aws online training
    aws online course
    learn aws online
    aws certification online
    aws certification training online

    ReplyDelete
  35. Thank you for sharing the article. The data that you provided in the blog is informative and effective.

    Tableau Training in Hyderabad

    ReplyDelete
  36. Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
    devops online training
    best devops online training
    top devops online training

    ReplyDelete
  37. https://maylamgiatot.wordpress.com/2021/01/07/tu-van-mua-may-tinh-cu-o-dau-gia-re/
    https://leuxonghoigiadinh.wordpress.com/2021/01/07/mua-may-tinh-cu-o-dau-gia-re/
    https://maynongnghiepdananggiare.wordpress.com/2021/01/07/tu-van-mua-may-tinh-cu-gia-re-o-dau/
    https://maylamdattrongngo.wordpress.com/2021/01/07/mua-may-tinh-cu-o-dau-gia-re-he-lo-dia-chi/
    https://mayxoidatnongnghiep.wordpress.com/2021/01/07/dia-chi-de-mua-may-tinh-cu-o-dau-gia-re/
    https://leuxonghoigiadinh.wordpress.com/2021/01/07/mua-may-tinh-cu-o-dau-gia-re/

    ReplyDelete
  38. Nice & Informative Blog !
    you may encounter various issues in QuickBooks that can create an unwanted interruption in your work. To alter such problems, call us at QuickBooks Customer Service Phone Number 1-(855) 738-7873 and get immediate technical services for QuickBooks in less time.

    ReplyDelete
  39. Nice Blog !
    Our team at QuickBooks Customer Service makes sure to assist you with the best-in-class services during this confusing time.

    ReplyDelete
  40. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.If you face any issue in QuickBooks, contact:
    QuickBooks Support phone numberFor quick solution.

    ReplyDelete
  41. Thanks for posting the best information and the blog is very helpful.python course in Bangalore

    ReplyDelete
  42. Really wonderful blog completely enjoyed reading and learning to gain the vast knowledge. Eventually, this blog helps in developing certain skills which in turn helpful in implementing those skills. Thanking the blogger for delivering such a beautiful content and keep posting the contents in upcoming days.

    data science certification in bangalore

    ReplyDelete

  43. I am really happy to say it’s an interesting post to read . I learn new information from your article , you are doing a great job . Keep it up

    Devops Training in Hyderabad

    Hadoop Training in Hyderabad

    Python Training in Hyderabad

    Tableau Training in Hyderabad

    Selenium Training in Hyderabad

    ReplyDelete
  44. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Course Syllabus

    ReplyDelete
  45. Users will get a clear picture of the customer and market behaviour and can make use of it to analyze the future performances of your business. salesforce lightning interview questions

    ReplyDelete
  46. I am really happy to say it’s an interesting post to read . I learn new information from your article , you are doing a great job . Keep it up

    Devops Training in Hyderabad

    Hadoop Training in Hyderabad

    Python Training in Hyderabad

    Tableau Training in Hyderabad

    Selenium Training in Hyderabad

    ReplyDelete
  47. Nice & Informative Blog !
    thanks for sharing excellent if you are QuickBooks user then contact at team at
    quickbooks phone number QuickBooks Solution

    ReplyDelete
  48. Easily, the article is actually the best topic on this registry related issue. I fit in with your conclusions and will eagerly look forward to your next updates. Just saying thanks will not just be sufficient, for the fantastic lucidity in your writing. I will instantly grab your rss feed to stay informed of any updates.
    data scientist course in hyderabad

    ReplyDelete
  49. virtual event platform Half of the respondents said that the use of virtual events during the pandemic enabled them to achieve increased attendance, while another 14.6 percent said virtual technology enabled them to at least maintain the attendance level of live events. online event site, thank you for meeting with me letter and staff meeting invitation email sample

    ReplyDelete
  50. thanks for sharing nice blog https://duckcreektraining.com/

    ReplyDelete
  51. Useful information. Fortunate me I found your website accidentally, and I’m stunned
    why this twist of fate did not took place in advance.
    I bookmarked it.
    cheq out my website Satta King Fast

    ReplyDelete
  52. This post is so interactive and informative.keep update more information...
    SEO Training in Anna Nagar
    SEO Training in Chennai

    ReplyDelete
  53. This is a great post. I like this topic.This site has lots of advantage.I found many interesting things from this site. It helps me in many ways.Thanks for posting this again. data science training in surat

    ReplyDelete
  54. Extremely overall quite fascinating post. I was searching for this sort of data and delighted in perusing this one.
    Continue posting. A debt of gratitude is in order for sharing.
    business analytics course in warangal

    ReplyDelete
  55. Experience the great learning of DevOps Training in Chennai with Infycle Technologies. Also get the most inquired technical courses like BlockChain, Digital Marketing, Graphic Design and Animation, Cyber Security, Full Stack Development, Big data, Data Science, Tableau, Power BI, Python, Cloud Platforms such as AWS, Azure, Google Cloud, Medical Coding, etc., with exclusive training and live Practical Sessions. To get a free demo for your future career, dial +91-7504633633.

    ReplyDelete
  56. Your post is very great. I read this post. It’s very helpful. I will definitely go ahead and take advantage of this. You absolutely have wonderful stories. Cheers for sharing with us your blog. For more learning about data science visit at data science course in Bangalore

    ReplyDelete