Monday, April 19, 2010

Cassandra Insert Throughput

** 0.5.1

Test Cluster:
DELL 2950 1*CPU Intel Xeon 5310 (4 cores)
5 nodes
1 node: 2GB heap for Cassandra JVM
4 nodes: 4GB heap for Cassandra JVM

Commit-log and Data stored on same disks.
25 client threads run on 5 nodes.

Data Model:
Keyspace Name = “Test”
Column Family Name = “ABC”
CompareWith for Column = LongType
Column Name = Timestamp (LongType), Value = 400 bytes binary
Billions of keys, thousands of columns.

Partitioner = dht.RandomPartitioner
MemtableSizeInMB = 64MB
ReplicationFactor = 3

Use Thrift Client Interface
Client.insert(..)
Consistency Level (write) = 1

Total inserted 1,076,333,461 columns.
Disk Use: 302GB+283GB+335GB+186GB+276GB=1,382GB (~~400B*1G=400GB *3= 1200GB)

On inserting: 1000 SSTables on each node. The latency of a query is about 1~3 seconds.
Quiet for long time: 10 SSTables (very big files, such as there is one 144GB SSTable data file)
The latency of a query is in ms.

Result: 18,000 columns/second


** 0.6.0
Only 4 nodes.

JVM GC for big heap.
Memory, GC..., always to be the bottleneck and big issue of java-based infrastructure software!
https://issues.apache.org/jira/browse/CASSANDRA-896 (LinkedBlockingQueue issue, fixed in jdk-6u19)

Seems 0.5.1 performed better.
0.6.0 eat more memory.

62 comments:

  1. Big data is now taking the guesswork out of discerning which individuals are the best targets for a particular product. To know more about SAP, Visit Big data training in chennai

    ReplyDelete
  2. The blog gave me idea about components of selenium. They explained in effective manner. Thanks for sharing it. Keep sharing more blogs.

    Selenium Training in Chennai

    ReplyDelete
  3. This information is impressive; I am inspired with your post writing style & how continuously you describe this topic.


    digital-marketing

    ReplyDelete
  4. Nice....bigdata is clearly explained..thanks for sharing..keep blogging

    ReplyDelete
  5. Your story is truly inspirational and I have learned a lot from your blog. Much appreciated.

    Python training in bangalore
    Python course in pune
    Python training in bangalore

    ReplyDelete
  6. Thanks for sharing useful article… Keep on updating such useful information. TN EPayslip | Manidhaneyam IAS Academy Entrance Exam

    ReplyDelete
  7. All the points you described so beautiful. Every time i read your i blog and i am so surprised that how you can write so well.Download All Technical Sagar courses Free worth 100$

    ReplyDelete
  8. All the points you described so beautiful. Every time i read your i blog and i am so surprised that how you can write so well.Download Best Friendship quotes for your best Friends

    ReplyDelete
  9. clipping path
    We are providing clipping path, remove background from image, drop shadow, photo retouching, photo cutout, raster to vector, and clipping path service.

    ReplyDelete
  10. Good information
    Yaaron Studios is one of the rapidly growing editing studios in Hyderabad. We are the best Video Editing services in Hyderabad. We provides best graphic works like logo reveals, corporate presentation Etc. And also we gives the best Outdoor/Indoor shoots and Ad Making services.
    Best video editing services in Hyderabad,ameerpet
    Best Graphic Designing services in Hyderabad,ameerpet­
    Best Ad Making services in Hyderabad,ameerpet­

    ReplyDelete
  11. Direct Digital marketing has alternate name Email Marketing.for that, you have to gather the information about your Target Audience.
    ExcelR Digital Marketing Courses In Bangalore

    ReplyDelete
  12. Thanks for blog are more informative step by step and useful contents. I here by attached my site would you see this blog.

    7 tips to start a career in digital marketing

    “Digital marketing is the marketing of product or service using digital technologies, mainly on the Internet, but also including mobile phones, display advertising, and any other digital medium”. This is the definition that you would get when you search for the term “Digital marketing” in google. Let’s give out a simpler explanation by saying, “the form of marketing, using the internet and technologies like phones, computer etc”.

    we have offered to the advanced syllabus course digital marketing for available join now

    more details click the link now

    https://www.webdschool.com/web-development-course-in-chennai.html

    ReplyDelete
  13. This blog are more informative.

    Web designing trends in 2020

    When we look into the trends, everything which is ruling today’s world was once a start up and slowly begun getting into. But Now they have literally transformed our lives on a tremendous note. To name a few, Facebook, Whats App, Twitter can be a promising proof for such a transformation and have a true impact on the digital world.

    we have offered to the advanced syllabus course web design and development for available join now

    more details click the link now

    https://www.webdschool.com/web-development-course-in-chennai.html

    ReplyDelete
  14. Very Good Information Share..
    Hostgator Se Hosting Kaise Kharide


    Very Good Information Share..
    Computer Kya Hai


    Very Good Information Share..
    download free blogger templates 2021


    Very Good Information Share..
    Free me website kaise bnaye 2021


    Very Good Information Share..
    Google Adsense Account Approval Kaise Karaye 2021

    ReplyDelete
  15. Its really good but see here is a problem in IPO

    ReplyDelete
  16. Very useful information thanks for sharing.

    ReplyDelete
  17. https://latestpunjabithoughts.blogspot.com/
    https://brillianthindifacts.blogspot.com

    ReplyDelete
  18. Thank you for sharing this Informative blog, it is very useful.

    Data Engineering Services

    ReplyDelete
  19. this is exactly what I was looking for rap lyrics, Thanks.

    ReplyDelete
  20. Become a data science expert by joining in AI Patasala’s Data Science Course in Hyderabad program, here you can learn practical knowledge with real-time experience.
    Data Science Training and Placements in Hyderabad

    ReplyDelete
  21. Hurrah, that’s what I was exploring for, what stuff! present here at this webpage, thanks, admin of this web page.

    ReplyDelete