Simple way to get missing number

On Tue, Apr 24, 2012 at 10:15:26AM -0400, Emi Lu wrote:

May I know is there a simple sql command which could return missing
numbers please?
For example,
t1(id integer)
values= 1, 2, 3 .... 5000000
select miss_num(id)
from t1 ;

select generate_series( (select min(id) from t1), (select max(id) from
t1))
except
select id from t1;

Best regards,

depesz

--
The best thing about modern society is how easy it is to avoid contact with it.
http://depesz.com/

Emi Lu <emilu@encs.concordia.ca> wrote:

Good morning,

May I know is there a simple sql command which could return missing
numbers please?

For example,

t1(id integer)

values= 1, 2, 3 .... 5000000

select miss_num(id)
from t1 ;

something like

,----[ code ]
| test=# select * from emi_lu ;
| i
| ---
| 1
| 2
| 3
| 5
| 6
| 8
| 9
| (7 rows)
|
| Time: 0,246 ms
| test=*# select * from generate_Series(1,10) s left join emi_lu on
| (s=emi_lu.i) where i is null;
| s | i
| ----+---
| 4 |
| 7 |
| 10 |
| (3 rows)
`----

this?

Andreas
--
Really, I'm not out to destroy Microsoft. That will just be a completely
unintentional side effect. (Linus Torvalds)
"If I was god, I would recompile penguin with --enable-fly." (unknown)
Kaufbach, Saxony, Germany, Europe. N 51.05082�, E 13.56889�

On 24 April 2012 16:15, Emi Lu <emilu@encs.concordia.ca> wrote:

Good morning,

May I know is there a simple sql command which could return missing numbers
please?

For example,

t1(id integer)

values= 1, 2, 3 .... 5000000

select miss_num(id)
from   t1 ;

Will return:
===============
37, 800, 8001

Thanks a lot!
Emi

You can use generate_series() for that, like so:

SELECT num AS missing FROM generate_series(1, 5000000) t(num)
EXCEPT
SELECT id AS missing FROM t1

--
If you can't see the forest for the trees,
Cut the trees and you'll see there is no forest.

Aha, generate_series, I got it. Thank you very much!!

I also tried left join, it seems that left join explain analyze returns
faster comparing with except:

select num as missing
from generate_series(5000, 22323) t(num)
left join t1 on (t.num = t1.id)
where t1.id is null
limit 10;

Emi

On 04/24/2012 10:31 AM, hubert depesz lubaczewski wrote:

On Tue, Apr 24, 2012 at 10:15:26AM -0400, Emi Lu wrote:

May I know is there a simple sql command which could return missing
numbers please?
For example,
t1(id integer)
values= 1, 2, 3 .... 5000000
select miss_num(id)
from t1 ;

select generate_series( (select min(id) from t1), (select max(id) from
t1))
except
select id from t1;

Best regards,

depesz

--
Emi Lu, ENCS, Concordia University, Montreal H3G 1M8
emilu@encs.concordia.ca +1 514 848-2424 x5884

On Tuesday 24 Apr 2012, Andreas Kretschmer wrote:

Emi Lu <emilu@encs.concordia.ca> wrote:

Good morning,

May I know is there a simple sql command which could return missing
numbers please?

For example,

t1(id integer)

values= 1, 2, 3 .... 5000000

select miss_num(id)
from t1 ;

something like

,----[ code ]

| test=# select * from emi_lu ;
|
| i
|
| ---
|
| 1
| 2
| 3
| 5
| 6
| 8
| 9
|
| (7 rows)
|
| Time: 0,246 ms
| test=*# select * from generate_Series(1,10) s left join emi_lu on
| (s=emi_lu.i) where i is null;
|
| s | i
|
| ----+---
|
| 4 |
| 7 |
|
| 10 |
|
| (3 rows)

Nice one, but curious about how would this perform if the numbers in
question extended into 7 figures or more?

Regards,

-- Raj
--
Raj Mathur || raju@kandalaya.org || GPG:
http://otheronepercent.blogspot.com || http://kandalaya.org || CC68
It is the mind that moves || http://schizoid.in || D17F

On 04/24/2012 07:15 AM, Emi Lu wrote:

Good morning,

May I know is there a simple sql command which could return missing
numbers please?

For example,

t1(id integer)

values= 1, 2, 3 .... 5000000

select miss_num(id)
from t1 ;

Will return:
===============
37, 800, 8001

T

select generate_series(1,5000000) except select id from t1;

Example

select anumber from fooo;
anumber
---------
1
3
5
7
9
11
13
15

select generate_series(1,15) except select anumber from fooo order by 1;
generate_series
-----------------
2
4
6
8
10
12
14

Cheers,
Steve

Raj Mathur (राज माथुर) <raju@linux-delhi.org> wrote:

Nice one, but curious about how would this perform if the numbers in
question extended into 7 figures or more?

<mode=David Fetter>
TIAS
(Try It And See)
</mode>

Andreas
--
Really, I'm not out to destroy Microsoft. That will just be a completely
unintentional side effect. (Linus Torvalds)
"If I was god, I would recompile penguin with --enable-fly." (unknown)
Kaufbach, Saxony, Germany, Europe. N 51.05082°, E 13.56889°

I got it and thank you very much for everyone's help!!

It seems that "left join where is null" is faster comparing with
"except". And my final query is:

select num as missing
from generate_series(5000, #{max_id}) t(num)
left join t1 on (t.num = t1.id)
where t1.id is null;

Emi

On 04/24/2012 11:10 AM, Emi Lu wrote:

I got it and thank you very much for everyone's help!!

It seems that "left join where is null" is faster comparing with
"except". And my final query is:

select num as missing
from generate_series(5000, #{max_id}) t(num)
left join t1 on (t.num = t1.id)
where t1.id is null;

BTW, there are many options. Two more of them include EXISTS:

select allnumbers from generate_series(1,15) as allnumbers where not
exists (select 1 from fooo where fooo.anumber=allnumbers.allnumbers);

And IN:

select allnumbers from generate_series(1,15) as allnumbers where
allnumbers not in (select anumber from fooo);

They all give you the same result. The "right" choice will depend on the
size of your table, how it is indexed, how fully it is populated and
even on your version of PostgreSQL. (Apologies for the funky field/table
naming.)

Cheers,
Steve