Idea And Website Advice
Idea And Website Advice
Author
Discussion

Wise

Original Poster:

165 posts

179 months

Tuesday 13th August 2013
quotequote all
Hi guys,

Looking for a bit of advice about a project/idae I have... But I'll start off by saying I have no really knowledge about coding or making any sort of web page outside of Wordpress laugh But have as much time as I want and willing to learn how to do it myself as I go along.

My basic idea is to make a site that you can search for what you want (Like ebay, autotrader etc etc.... Where you can pick what you want, brand, make, size, price and distance away etc) But I want my site be a 'hub' one site you can go to, to search for what you want and will search all the site with relevance to the product you have searched for. And give you all the results for the related products you searched for with out going through the 10-20+ different sites entering in all the details.

So basically I want to make a site with a similar interface as ebay, autotrader etc. But will search multiple sites and give you the results in one place.

Sorry If it does make much sense but don't want to give to much away. Just looking for a bit of advice on where would be best to start and if its even possible... laugh

mondeoman

11,430 posts

297 months

Tuesday 13th August 2013
quotequote all
You mean like Google?

droopsnoot

14,806 posts

273 months

Tuesday 13th August 2013
quotequote all
Hmm, so like a big product category listing, but inside each of the categories you'd end up with product listings from other sites? That bit won't be hard to code, getting the information from the other sites (and keeping it up to date) is probably the biggest issue.

Wise

Original Poster:

165 posts

179 months

Tuesday 13th August 2013
quotequote all
Kind of but not really, have read into that and basically making a search engine running off goggle and you can choose the sites/content you want it to search but not sure it will work for this...

I mean for more a niche/specialised searches. Where the interface is like autotrader and here, with pull down menus. But will search multiple sites and will list the results the autotrader and here on my site and will be linked to the original site. The market am aiming for will be used/second hand goods, if that makes it easier to understand what I want to do.

anonymous-user

85 months

Tuesday 13th August 2013
quotequote all
http://www.ebizmba.com/articles/shopping-websites

Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).

Wise

Original Poster:

165 posts

179 months

Wednesday 14th August 2013
quotequote all
fatbutt said:
http://www.ebizmba.com/articles/shopping-websites

Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).
Not really what am looking for and there are a few similar price comparison sites in the UK.

Anyone got any advice on where I can start looking into coding and how to go about starting etc have had a search myself but there far to much to take in at once.... I need a starting point laugh

Like I said it's going to be a side project with no real time scale, so can take my time and willing to learn smile

anonymous-user

85 months

Wednesday 14th August 2013
quotequote all
Wise said:
Not really what am looking for and there are a few similar price comparison sites in the UK.

Anyone got any advice on where I can start looking into coding and how to go about starting etc have had a search myself but there far to much to take in at once.... I need a starting point laugh

Like I said it's going to be a side project with no real time scale, so can take my time and willing to learn smile
If you're struggling to explain what your concept is then you may struggle to get your message across as to how your site is 'not just another price comparison site'. As for coding, no-one really 'codes' anymore; they use software such as dreamweaver to do all that for them.

http://en.wikipedia.org/wiki/Adobe_Dreamweaver

Edited by anonymous-user on Wednesday 14th August 15:08

Wise

Original Poster:

165 posts

179 months

Wednesday 14th August 2013
quotequote all
I know what you mean, I know what I want and dont want to give to much away as as far as I know there in not a similar site, well at least in the UK anyway.

Basic out line is. I want an imput interface like on here and autotrader etc. with pull down menus. Make, price, distance etc...
It will list all the results like ebay or similar. Then when you click the product it will take you to the original site it is being sold on.

So it is basically a comparison site.

LooneyTunes

9,542 posts

189 months

Wednesday 14th August 2013
quotequote all
esvcg said:
oh yes they do, and alot!

Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.
Indeed, but does anyone still use dreamweaver these days?

droopsnoot

14,806 posts

273 months

Wednesday 14th August 2013
quotequote all
Dreamweaver isn't too bad as a wysiwyg tool for someone creating basic sites without specific HTML or CSS knowledge, but as soon as you run into a display problem that only happens on certain browsers at certain sizes, you're going to need to be able to sort it out and DW (or any of the others) won't help there. You can build just as good a site with Notepad, or the free Notepad++, once you have the grasp of it. There are probably professional (expensive) tools available to manage code libraries, but it's early for that.

But that's not the OPs problem. I think the trouble will be getting the data from the other sites. The larger ones will probably have some kind of API to access their catalogue, but the smaller ones won't unless they are built on a platform that does that automatically. You also need to make sure that when you're sending visitors off to these sites, that you get an affiliate fee back from them - that's where the money will come from.

mozzerS

121 posts

236 months

Wednesday 14th August 2013
quotequote all
droopsnoot said:
You also need to make sure that when you're sending visitors off to these sites, that you get an affiliate fee back from them - that's where the money will come from.
Do you know how to go about getting an affiliate fee or setting it up with a smaller company/supplier. E.g. one that is not signed up to an affiliate program like affilinet? I assume the OP would be interested - and I certainly would wink

anonymous-user

85 months

Wednesday 14th August 2013
quotequote all
esvcg said:
oh yes they do, and alot!

Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.

coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.

developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.

There's a crucial difference between being a click monkey and a coder or developer!

Edited by esvcg on Wednesday 14th August 16:14
Ok, to clarify, the majority of sites made are made with software such as dreamweaver. Sure, there are still those that code (and I'm sure they code 'a lot') but what I'm saying is that you don't need to know java or whatever to create a website. Its not like in the 90's when you had to know HTML.

cornet

1,471 posts

189 months

Wednesday 14th August 2013
quotequote all
fatbutt said:
esvcg said:
oh yes they do, and alot!

Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.

coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.

developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.

There's a crucial difference between being a click monkey and a coder or developer!

Edited by esvcg on Wednesday 14th August 16:14
Ok, to clarify, the majority of sites made are made with software such as dreamweaver. Sure, there are still those that code (and I'm sure they code 'a lot') but what I'm saying is that you don't need to know java or whatever to create a website. Its not like in the 90's when you had to know HTML.
Most sites these days are created using a CMS (Content Management System). Dreamweaver may be used by the front end designers/developers but I've not come across anyone using for at least 8 years.



Now for the site in question this is not an easy task. There are a few parts that need to be considered:

How the site will look and how you interact with it: This part is probably the easiest to learn, requires you to learn HTML/CSS and most likely some Javascript.

From this knowledge you should be able to create a mockup of the site.


The back end code: Now we are onto what some people deem "real programming". This is going to cover how to you get the data from other websites. This could be done a number of ways. Ideally by interacting with the remote site's API (Application Programming Interface) so you can make a request to them with the search criteria and they hand you back the results.

Not all sites have an API though, so for these you will need to "scrape" the site and extract everything. However every time they change the layout of the site your code may need to be updated. This could turn into a full time job pretty quickly.

Your choice of languages here could be any of Ruby, Python, PHP, Java, etc. If you've never done any programming before I would probably say go for Ruby + Ruby on Rails. Excellent support community and there are a plethora of ways to host it for free to start with.

So now you can take your mockup and create something that goes off and searches one or two websites.


Storage Pretty quickly you'll need to start storing stuff in a database (MySQL or PostgreSQL) to save searches, user login details etc... You could also start storing the details of the products in there for sites that allow you access to a complete list of products. However I would refrain from doing this for as long as you can and make the requests in real time where ever possible.


I could go on to the next stages but there is no point at all in worrying about those until you've got something working as above. For sites like you describe no one designs the whole thing any more. They start off with a minimal set of requirements, get that working, then decide what to do next.

Could you do the above with no prior programming experience? As long as you are willing to learn then of course you can. I've seen people do it before. Just take your time and enjoy the learning process and expect to keep re-writing your code. When developing any website or program you should follow these three steps at any stage:

1. Make it work
2. Make it elegant (i.e. tidy up your code and method)
3. Make it faster when required.


jammy_basturd

29,778 posts

243 months

Wednesday 14th August 2013
quotequote all
Bookmarked (mobile).

PS. Sounds like you need to formulate a business plan before asking about coding.

LooneyTunes

9,542 posts

189 months

Thursday 15th August 2013
quotequote all
esvcg said:
to add to advice above:
1. Make it work
2. Make it elegant (i.e. tidy up your code and method)
3. Make it faster when required.
4. If you make time estimates, the actual time will be at least twice as long
5. Scale slowly, better to start with a small working project, than a big pile of poo
6. Plan early for the future
7. Make it flexible to take into account scaling (linked to 3)
8. Anticipate potential changes in the way other sites work/the market functions.

fatbutt said:
Ok, to clarify, the majority of sites made are made with software such as dreamweaver.
The only time we've even looked at Dreamweaver was when the least techie of our team (me) wanted to generate some documents in HTML (cleaner than M$ could output) to save the rest of the guys a bit of work.

Not one of our techies has ever asked for it - dependent on what they're doing, they work from pretty much the same mix as Cornet outlines.

jammy_basturd

29,778 posts

243 months

Thursday 15th August 2013
quotequote all
Before you need to worry yourself about coding, you need to make sure you actually have an idea that will work and make you some money.

As others have said, you don't seem to be able to distinguish this site from any of the price comparison sites out there. What is your USP?

Also, from a technical stand point, this isn't so easy. Either you're going to have a st tonne of data input, in order to populate a database with all the different items, colours, sizes, variations, etc. Or you require a website that is clever enough to scrape other websites and work out what the products are, then work out what the product models are, then work out what all the different variations of that product model are. In addition to that this system of yours would have to de-dupe a lot of data and match up slight discrepancies in product data between websites.

This is not a cheap system to do well.

Then what is your plan for marketing? First off you'll be competing with Google Shopping listings, eBay and Amazon. How do you plan to compete with them?

Lastly, look at The Lean Startup (book by Eric Reis), you should be able to find a number of websites about the methodology. It makes you validate your business ideas incrementally and stops you from wasting a lot of money.

Wise

Original Poster:

165 posts

179 months

Thursday 15th August 2013
quotequote all
Cheers for all the advice guy, it's being a really helpful.

I do have a rough business plan/idea just now, but I am just starting to play about online trying to make money through affiliates etc. As a bit of a side project, when I had this idea which is going to be a really long term project... I know its going to be difficult and a steep learning curve laugh

Basically it is going to be price comparison, but it's in a niche that gets a lot of traffic and will solve problems that I know loads of people have. The way I plan on making money will be through affiliates and ad space when there is even traffic going though the site. But it is in the very early stages and am trying to refine the idea, before I go a head. Just making sure it's going to actually be doable to get the data from the other sites etc.

As for scraping the data from the other sites, will I need some sort of software or coding to do that? Sorry for all the silly questions. Just trying to get an idea of how much work is actually going to be involved.

droopsnoot

14,806 posts

273 months

Thursday 15th August 2013
quotequote all
Wise said:
As for scraping the data from the other sites, will I need some sort of software or coding to do that? Sorry for all the silly questions. Just trying to get an idea of how much work is actually going to be involved.
The only way I could think of doing this would be to have some code that connects to the site in the same way that a browser does, and have it then scan the downloaded page for the data. This is why you have to keep watch on the sites you are scraping - as soon as they change the page layout, you have to change your scraper code to look for different data. With a lot of modern sites making extensive use of javascript to slow down enhance the user experience, that could be quite some job, though I would imagine scraping code is probably around.

droopsnoot

14,806 posts

273 months

Thursday 15th August 2013
quotequote all
mozzerS said:
Do you know how to go about getting an affiliate fee or setting it up with a smaller company/supplier. E.g. one that is not signed up to an affiliate program like affilinet? I assume the OP would be interested - and I certainly would wink
No, sorry. If you approach the company directly, it might be that the only reason they're not on an affiliate program is because they haven't thought of it, or didn't think anyone would be interested. I added it to a site I worked on because people showed an interest, and most smaller sites would be the same.