By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
World of SoftwareWorld of SoftwareWorld of Software
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Search
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
Reading: How to Fix Sqoop Not Found and ClassNotFound in DolphinScheduler | HackerNoon
Share
Sign In
Notification Show More
Font ResizerAa
World of SoftwareWorld of Software
Font ResizerAa
  • Software
  • Mobile
  • Computing
  • Gadget
  • Gaming
  • Videos
Search
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Have an existing account? Sign In
Follow US
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
World of Software > Computing > How to Fix Sqoop Not Found and ClassNotFound in DolphinScheduler | HackerNoon
Computing

How to Fix Sqoop Not Found and ClassNotFound in DolphinScheduler | HackerNoon

News Room
Last updated: 2025/07/10 at 5:09 PM
News Room Published 10 July 2025
Share
SHARE

Integrating DolphinScheduler with Sqoop can streamline data synchronization across systems. But beginners often run into frustrating errors during setup and execution.

This guide walks you through common pitfalls, complete with real-world error messages, solutions, and configuration tips. Whether you’re struggling with environment variables, classpath issues, or malformed Sqoop commands, this article will help you get data flowing smoothly in no time.

1. Error when creating a tenant in DolphinScheduler: Permission denied

If you see an error in the logs indicating insufficient permissions when creating a tenant in DolphinScheduler, you can enable permissions using the following command:

hdfs dfs -chmod 777 /

2. Encountering the following error

Sqoop: command can’t be found

The possible issues may be:

  1. Sqoop is not installed;
  2. or it is installed but not configured in the environment variables of DolphinScheduler.
  3. Can the full path be used instead?

Let’s check how DolphinScheduler integrates with Sqoop:

At the end of the configuration file shown above, add the following lines:

export SQOOP_HOME=/opt/installs/sqoop

export PATH=$SQOOP_HOME/bin:$HADOOP_HOME/bin:$SPARK_HOME1/bin:$SPARK_HOME2/bin:$PYTHON_HOME/bin:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_HOME/bin:$SEATUNNEL_HOME/bin:$CHUNJUN_HOME/bin:$PATH

Then restart DolphinScheduler:

# Check status
bash ./bin/dolphinscheduler-daemon.sh status standalone-server

# Stop DolphinScheduler
bash ./bin/dolphinscheduler-daemon.sh stop standalone-server

# Start DolphinScheduler
bash ./bin/dolphinscheduler-daemon.sh start standalone-server

3. If you encounter the following error:

Caused by: java.lang.ClassNotFoundException: Class QueryResult not found
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2571)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2665)
    ... 12 more 

Temporary solution:

Copy the QueryResult.jar file to the lib directory of Sqoop.

[INFO] 2024-09-25 06:19:16.083 +0000 -  -> Note: /tmp/sqoop-root/compile/46c0c4b3def5aba0c202ae9664234de6/QueryResult.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

# Based on the log, go to this path:
cd /tmp/sqoop-root/compile/46c0c4b3def5aba0c202ae9664234de6

# Copy the jar file
cp /tmp/sqoop-root/compile/46c0c4b3def5aba0c202ae9664234de6/QueryResult.jar  /opt/installs/sqoop/lib/

Permanent solution:

Add the following line to DolphinScheduler’s configuration file:

33

At the bottom of the config file, add:

export HADOOP_CONF_DIR=/opt/installs/hadoop/etc/hadoop

After configuration, restart DolphinScheduler:

# Check status
bash ./bin/dolphinscheduler-daemon.sh status standalone-server

# Stop
bash ./bin/dolphinscheduler-daemon.sh stop standalone-server

# Start
bash ./bin/dolphinscheduler-daemon.sh start standalone-server

4. Error log example:

[INFO] 2024-09-25 06:27:53.628 +0000 -  -> 2024-09-25 14:27:52,757 INFO  [main] sqoop.Sqoop (Sqoop.java:<init>(96)) - Running Sqoop version: 1.4.7
    2024-09-25 14:27:52,824 ERROR [main] tool.BaseSqoopTool - Error parsing arguments for import:
    2024-09-25 14:27:52,825 ERROR [main] tool.BaseSqoopTool - Unrecognized argument: dt
    2024-09-25 14:27:52,825 ERROR [main] tool.BaseSqoopTool - Unrecognized argument: 2024-09-24
    ...

This indicates that there is a syntax error in the Sqoop command used in the DolphinScheduler workflow:

Double-check your workflow’s Sqoop command:

Delete the Sqoop parameter:

[INFO] 2024-09-25 06:34:34.639 +0000 -  -> Sqoop version: 1.4.7
WARN - Setting password on command-line is insecure. Consider using -P instead.
ERROR - Must specify destination with --target-dir. Try --help for usage instructions.

If this happens, modify the command:

Target path of Hive: /tmp/user_orclog

If you see the following SQL syntax error:

Error executing statement: java.sql.SQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '%Y-%m-%d) = 2024-09-24 AND  (1 = 0)' at line 1

→ Replace double quotes with single quotes in your SQL statement.

5. Hive Error

Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: ParseException line 45:21 cannot recognize input near ';' '<EOF>' '<EOF>' in expression specification

Solution:

Use the SQL task type, and do not add a semicolon (;) at the end of the statement.

Sign Up For Daily Newsletter

Be keep up! Get the latest breaking news delivered straight to your inbox.
By signing up, you agree to our Terms of Use and acknowledge the data practices in our Privacy Policy. You may unsubscribe at any time.
Share This Article
Facebook Twitter Email Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Google Pixel 9 vs. Samsung Galaxy S25+: Which Prime Day Deal Should You Buy?
Next Article AlbionVC: London still outpaces Paris in tech – UKTN
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected

248.1k Like
69.1k Follow
134k Pin
54.3k Follow

Latest News

Google testing new ‘Parental controls’ setting in Android Canary
News
Podcast: HDDs performance metrics and the workloads they excel at | Computer Weekly
News
Teen rescued from deserted island after being swept 9 miles offshore
News
Today's NYT Mini Crossword Answers for July 11 – CNET
News

You Might also Like

Computing

ByteDance releases Ola Friend, its first AI smart earbuds · TechNode

1 Min Read
Computing

Xpeng talks about camera-based approach with new electric sedan · TechNode

5 Min Read
Computing

Ready to Expand in Asia? BEYOND Expo’s Regional Cooperation Forums Are Where Global Ambitions Take Off · TechNode

6 Min Read
Computing

Starbucks China stake sale draws bids valuing business up to $10 billion · TechNode

4 Min Read
//

World of Software is your one-stop website for the latest tech news and updates, follow us now to get the news that matters to you.

Quick Link

  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact

Topics

  • Computing
  • Software
  • Press Release
  • Trending

Sign Up for Our Newsletter

Subscribe to our newsletter to get our newest articles instantly!

World of SoftwareWorld of Software
Follow US
Copyright © All Rights Reserved. World of Software.
Welcome Back!

Sign in to your account

Lost your password?