在很大的循环中生成唯一标识符-Java

Question

the question i am going to ask is very old and i think it asked on SO 5-10 times.

but mine has a different situation.

Read my Problem before making it duplicate by so many wise (over) SO users.

I am importing CSV sheet containing 10K records in my application.

My logic works in following manner,

(1) Validate & Import Sheet (2) Save to the database if record does not exist

Step 2 is done for each and every record of the sheet.

in the step -2 i have to generate UUID to identify a particular record later ,

in my first solution

// this might be unique in some cases
String id = UUID.randomUUID().toString();

but i checked that it does generate unique id in each case , for example if i import 10 sheet one by one with different records in it, all 10 times i am getting duplicate key error from database for at least 4000 times in each import and save operation,

that means that out of 10,000 key generation it generates only 6000 unique ids.

so then i generate an alphanumeric code which length is 6 , some thing like

eSv3h7

and append it to previously generated id and hence get the following id

d545f2b2-63ab-4703-89b0-f2f8eca02154-eSv3h7

after testing still there is a problem of id duplication.

I also tried several combination mentioned here and on other sites but still there is a same problem of id duplication,

Now i am wondering that this occurs only for 10k records saving in loop , actually i need to import sheet which is having 8 million records in it

so how can i solve my problem of generating a Unique id in my particular case ?

Update 1 - based on all the comments

Try this thing at you end.

loop through 1 to 10,000 generate uuid in the loop store it somewhere in simple text file

then make a simple program to find the duplicates from them , if you do not find any one duplicate in first attempt , repeat all above steps again and again and i am sure you will find duplicates.

in the past i am also strong believer of the same thing that UUID will never generates duplicates, share me your result of above test.

Update 2 - Code

This is the method which is called by each record of the sheet to be saved by caller method' loop.

@Override

public void preSynchronizedServiceExecution(ServiceData sData,
            ValueObject valueObject) throws BlfException {

        PropertyVO pVO = (PropertyVO) valueObject;

        ArrayList<CountyAuctionPropertyVO> capList = pVO
                .getCountyAuctionPropertyList();

        for (CountyAuctionPropertyVO caVO : capList) {

            TadFrameworkUtil.processValueObjectKeyProperty(caVO, true);

            TadFrameworkUtil.processValueObjectKeyProperty(caVO
                    .getPropertyLastOwner(), true);

            TadFrameworkUtil.processValueObjectKeyProperty(caVO
                    .getPropertyLastOwner().getAdd(), true);

        }

        ArrayList<PropertyAminitiesVO> amList = pVO.getPropertyAminitiesList();

        for (PropertyAminitiesVO pamVO : amList) {

            TadFrameworkUtil.processValueObjectKeyProperty(pamVO, true);

        }

        ArrayList<PropertyAttributesVO> atList = pVO
                .getPropertyAttributesList();

        for (PropertyAttributesVO patVO : atList) {

            TadFrameworkUtil.processValueObjectKeyProperty(patVO, true);

        }

        TadFrameworkUtil.processValueObjectKeyProperty(pVO, true);

        TadFrameworkUtil.processValueObjectKeyProperty(pVO.getSiteAdd(), true);
    }

Following is id generation method

public static String generateUUID() throws BlfException {

        // this might be unique in some cases
        String id = UUID.randomUUID().toString();

        // introduce custom random string in mixing of upper and lower
        // alphabets,
        // which is 6 character long
        // and append it to generated GUID.
        String rs = randomString(6);

        id = id.concat("-").concat(rs);

        return id;
    }

Update 3 (Method added)

public static void processValueObjectKeyProperty(ValueObject valueObject,
            boolean create) throws BlfException {

        String key = (String) BlfConverter.getKey(valueObject);

        if (!StringUtility.isStringNonEmpty(key)) {
            throw new BlfException(valueObject.getObjectName()
                    + "-  key property does not exist.");
        }

        if (create) {

            String id = generateUUID();

            valueObject.setProperty(key, id);
        } else {

            String exisitingId = valueObject.getProperty(key);

            if (!StringUtility.isStringNonEmpty(exisitingId)) {

                String id = generateUUID();

                valueObject.setProperty(key, id);
            }
        }
    }

The random string method is just a simple methods of 2 lines which generates alpha numeric random string of length 6.

please ask me if you need anything more so i can post here.

Update 4 (Sample genearted UUID )

d545f2b2-63ab-4703-89b0-f2f8eca02154-eSv3h7
6f06fa28-6f36-4ed4-926b-9fef86d002b3-DZ2LaE
20142d05-f456-4d72-b845-b6819443b480-xzypQr
67b2a353-e7b4-4245-90a0-e9fca8644713-AgSQZm
8213b275-2cb1-4d37-aff0-316a47e5b780-vMIwv9

and i am getting accurate result from database if i need to fetch it from there.

Thanks

Answer 1

Thanks for all your user who seriously study my question and spent some time to help me in solving it.

I found that the error was in Database layer of business logic foundation.

One of the Object needs to Updated but it was created using previous existing id so that i was getting the Duplicate Primary key Error.

I develop a Unit Test for id generation and tested UUID for more than one billion key , it is guaranteed to be unique, it is true in all circumstances.

Thanks again to everyone.