What techniques in Hadoop ecosystem can achieve second-level querying for 1 TB data?

Posted by Tejaswini on January 31, 2017 at 13:44

Hi I'm new in hadoop ecosystem. I have a question. What technology can return simple query results in seconds? Say we have 1 TB data in CSV format. We want to query data like what we do in traditional database. And we want to get the result in seconds.

I've tried put the files on HDFS and use Hive on MapReduce, Hive on Spark to query. None of them can achieve that. They return the result in almost an hour.

My point is, regardless of the hardware condition. Is there any technology much much faster than Hive?

You need to be a member of Global Risk Community to add comments!

Join Global Risk Community

Tags: hive, ecosystem, hadoop
Email me when people reply –
Follow

    About Us

    The GlobalRisk Community is a thriving community of risk managers and associated service providers. Our purpose is to foster business, networking and educational explorations among members. Our goal is to be the worlds premier Risk forum and contribute to better understanding of the complex world of risk.

    Business Partners

    For companies wanting to create a greater visibility for their products and services among their prospects in the Risk market: Send your business partnership request by filling in the form here!

lead