Code geek, looking for help from car geeks
Code geek, looking for help from car geeks
Author
Discussion

Matt196695

Original Poster:

31 posts

51 months

Wednesday 27th July 2022
quotequote all
I'm searching for some kind of open source database of EVERY CAP Code there is in existence for a software project I'm building. (not sure if this is a UK-only thing... or worldwide).

It seems from what I've seen that CAP-HPI are sitting on this data and monetising for ££££. However, it's literally open-source data without a secret behind it. Unless CAP-HPI are quite literally the generator of the CAP codes? And if that is the case, has anybody had experience with CAP-HPI. Their prices, and so on.

Edited by Matt196695 on Wednesday 27th July 17:10

SAS Tom

3,755 posts

204 months

Wednesday 27th July 2022
quotequote all
What’s a CAP code and who are CAP-HDI?

Matt196695

Original Poster:

31 posts

51 months

Wednesday 27th July 2022
quotequote all
This is a CAP code: https://business.cap.co.uk/products-and-services/c... and this is CAP HPI: https://www.cap-hpi.com/

Apparently, it's industry-standard... it's the identifier of each type of vehicle. Example, all: Corsa, 3 door, 1l, 2008... will have the same CAP Code.

Edited by Matt196695 on Wednesday 27th July 17:12

Olivergt

2,267 posts

111 months

Wednesday 27th July 2022
quotequote all
Looks like it's not free, although I can't find any pricing.

https://api.cap-hpi.co.uk/docs/index.html

Also, it may be possible to get some of the data for free, maybe worth sending them an email?

Matt196695

Original Poster:

31 posts

51 months

Wednesday 27th July 2022
quotequote all
Olivergt said:
Looks like it's not free, although I can't find any pricing.

https://api.cap-hpi.co.uk/docs/index.html

Also, it may be possible to get some of the data for free, maybe worth sending them an email?
Yeah, it's not free. I have a funny feeling that it'll be very expensive too. To me, it's mind-blowing that something so simple could be monetised with such aggressive margins. (this is an assumption, but when a business doesn't show pricing...)

I'm half tempted to just code up a free identifying system & make it open source.


Edited to add: I'm waiting for a phone call from CAP HPI. My brain just couldn't process that this kind of basic information wasn't open source.

NMNeil

5,860 posts

80 months

Wednesday 27th July 2022
quotequote all
Does this help, or point you in the right direction?
https://github.com/totov/laravel-cap-hpi

Matt196695

Original Poster:

31 posts

51 months

Wednesday 27th July 2022
quotequote all
That being said, I guess it wouldn't be difficult to reverse engineer


Matt196695

Original Poster:

31 posts

51 months

Wednesday 27th July 2022
quotequote all
NMNeil said:
Does this help, or point you in the right direction?
https://github.com/totov/laravel-cap-hpi
Thanks for sharing that Neil, but that's basically to help coders code a system to communicate with CAP HPI directly (giving them a fee each time your computer does it to get said information). Still may be useful in the future though, so cheers.

768

20,734 posts

126 months

Wednesday 27th July 2022
quotequote all
What are you actually after / trying to do? Do you need to know every used value or just understand the permutations? I see there's a database of car reviews you could scrape for example values here along with a slightly different description of the format here.

The format seems open, but data's where the money is, I'm not surprised they're sitting on it.

Matt196695

Original Poster:

31 posts

51 months

Thursday 28th July 2022
quotequote all
768 said:
What are you actually after / trying to do? Do you need to know every used value or just understand the permutations? I see there's a database of car reviews you could scrape for example values here along with a slightly different description of the format here.

The format seems open, but data's where the money is, I'm not surprised they're sitting on it.
Basically... uh, I don't want to give too much away but dealerships will be shipping their feeds of cars to my website. For me to compare each EXACT vehicle, and compare it against all the dealers... I need an identifier. Supposedly, it's industry standard to use CAP_ID in this use case.

This was a fantastic bit of knowledge/or research! Can I ask, how did you find this and what was the thought process? & if you aren't already in tech, reconsider your career!

This is very useful. There is one downfall, and that is the browser cannot deal with many queries at once. Even asking it to return 50 unique vehicles, the browser timeouts... And I should think there are thousands of unique CAP_IDs. But... I'm trying to find a workaround for this.

Other websites with similar would be wonderful. Rather than a webservice, a JSON response would be the holy grail!

vaud

59,702 posts

185 months

Thursday 28th July 2022
quotequote all
FYI some sites have anti-scraping technologies to stop you doing exactly this.

LinkedIn has one for example.

Matt196695

Original Poster:

31 posts

51 months

Thursday 28th July 2022
quotequote all
vaud said:
FYI some sites have anti-scraping technologies to stop you doing exactly this.

LinkedIn has one for example.
I deal with this kind of thing on a daily thankfully, this kind of technology is bypassable 99% of the time.

123DWA

1,439 posts

133 months

Thursday 28th July 2022
quotequote all
Matt196695 said:
Basically... uh, I don't want to give too much away but dealerships will be shipping their feeds of cars to my website. For me to compare each EXACT vehicle, and compare it against all the dealers... I need an identifier. Supposedly, it's industry standard to use CAP_ID in this use case.

!
I'm guessing you want to make some kind of price comparison site or a site that shows if a car is fairly priced? If so then CAP codes wont take spec into account which on some cars is the difference between people fighting over it & not being able to give it away.

Matt196695

Original Poster:

31 posts

51 months

Thursday 28th July 2022
quotequote all
123DWA said:
Matt196695 said:
Basically... uh, I don't want to give too much away but dealerships will be shipping their feeds of cars to my website. For me to compare each EXACT vehicle, and compare it against all the dealers... I need an identifier. Supposedly, it's industry standard to use CAP_ID in this use case.

!
I'm guessing you want to make some kind of price comparison site or a site that shows if a car is fairly priced? If so then CAP codes wont take spec into account which on some cars is the difference between people fighting over it & not being able to give it away.
All the cars are brand new. They're all fresh out of the factory. So, in that situation, the CAP_ID (should) give all the information that's needed.

Matt196695

Original Poster:

31 posts

51 months

Sunday 5th March 2023
quotequote all
768 said:
What are you actually after / trying to do? Do you need to know every used value or just understand the permutations? I see there's a database of car reviews you could scrape for example values here along with a slightly different description of the format here.

The format seems open, but data's where the money is, I'm not surprised they're sitting on it.
This is the closest I've found to a solution, but unfortunately the CAP data is not up to date. It doesn't have newer CAP codes. frown

Tankrizzo

8,025 posts

223 months

Sunday 5th March 2023
quotequote all
(Posting here as I see you had a new thread closed).

CAP IDs and CAP Codes are not open source. They are proprietary codes generated by CAP for every new variant that comes out. There are other data providers you can look at - JATO for example, but they all charge because at the end of the day they are collating all models from all manufacturers into one format of data that companies can use, and that costs money.

CAP are aggressive in both pricing and pursuing people who use their data without a licence, so expect a legal letter if you develop a paid service using CAP codes without subscribing to them.

Tankrizzo

8,025 posts

223 months

Sunday 5th March 2023
quotequote all
Also you should bear in mind that these datasets - CAP ID for example - only identifies the base model and not any options which have been specced on it, so a built car with the same CAP ID might differ hugely in spec than one sitting alongside it with the same ID.

Matt196695

Original Poster:

31 posts

51 months

Sunday 5th March 2023
quotequote all
Any idea how much they cost?

sunnyb13

1,204 posts

68 months

Sunday 5th March 2023
quotequote all
Tankrizzo said:
(Posting here as I see you had a new thread closed).

CAP IDs and CAP Codes are not open source. They are proprietary codes generated by CAP for every new variant that comes out. There are other data providers you can look at - JATO for example, but they all charge because at the end of the day they are collating all models from all manufacturers into one format of data that companies can use, and that costs money.

CAP are aggressive in both pricing and pursuing people who use their data without a licence, so expect a legal letter if you develop a paid service using CAP codes without subscribing to them.
This.

Matt196695

Original Poster:

31 posts

51 months

Sunday 5th March 2023
quotequote all
Yes but from your experience, could you provide me with rough pricing estimates for each provider?