Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

All work

Go to all work items
Select view

Select search mode

 
50 of 58

When running many concurrent SQOOP processes, some SQOOP logs are missing.

Done

Description

Back in case  we fixed the mixed logs, but now from time to time the SQOOP logs are missing.

We identified that the issue is linked to the fact that the ChannelId is not unique on concurrent processes that run very close to each other.

ChannelId

Thread

_time

Count of ChannelId

5c3272a7-3781-44c9-9575-3f5888542b1c

 

 

2

 

Thread[Thread-10676,5,main]

1

 

 

2022-02-12T19:55:37.586+0100

1

 

Thread[Thread-11134,5,main]

1

 

 

2022-02-12T19:56:00.091+0100

1

9d55190a-8d9a-43b6-b1f8-a6dd7cd9166b

 

 

2

 

Thread[Thread-11080,5,main]

1

 

 

2022-02-12T19:55:56.495+0100

1

 

Thread[Thread-9568,5,main])

1

 

 

2022-02-12T19:55:32.681+0100

1

093bc01c-3dc8-4197-b4b5-f8ca38ef33cc

 

 

2

 

Thread[Thread-19035,5,main]

1

 

 

2022-02-12T19:57:06.677+0100

1

 

Thread[Thread-21674,5,main]

1

 

 

2022-02-12T19:57:28.688+0100

1

 

 

Steps to Reproduce

It is necessary to run around 40-50 concurrent SQOOP processes to replicate the scenario.

Customer currently runs about 100 SQOOP processes and this issue happens 4-5 times on every cycle.

 

Workaround

None

Attachments

4

Details

Assignee

Reporter

Labels

Edit Screen Preamble

<div class="notify info" style="margin-bottom: 10px;">
If you are a Pentaho customer, please use the <a href="http://support.pentaho.com">Customer Support portal</a> to log issues.
<p />
This system is used for logging bugs and enhancement requests only. Please use our <a href="https://community.pentaho.com">community at https://community.pentaho.com</a> if you have questions, configuration issues, or have an issue with a marketplace plugin as Pentaho does not support marketplace plugins unless written by Pentaho.
<p />
Lastly, when creating a bug, please provide as much detail as possible. To prevent unnecessary delays in reviewing your issue, please attach complete server logs, SQL/MDX logs where applicable, schemas, etc. Also, screen-shots and screen-cams are especially helpful in demonstrating the issue.
<p />
Thank-you so much,<br />
The Pentaho Team
</div>

Notice

<div class="notify info" style="margin-bottom: 10px;">
When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
</div>

Sprint Team

Story Points

Affects versions

Priority

Created February 14, 2022 at 3:53 PM
Updated September 20, 2024 at 5:51 AM
Resolved January 11, 2023 at 11:45 AM

Activity

Show:

ATRCM Official 
September 20, 2024 at 5:51 AM